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FOREWORD 


THE PRESENT book, together with its companion volume devoted to 
the differential and integral calculus, contains the fundamental part 
of the material dealt with in the larger courses of mathematical 
analysis. Included in this volume are general problems of the theory 
of continuous functions of one and several variables (with the 
geometrical basis of this theory), the theory of limiting values for 
sequences of numbers and vectors, and also the theory of numerical 
series and series of functions and other analogous infinite processes, 
in particular, infinite continued fractions. 

Chapter I, “The arithmetical linear continuum and functions 
defined there’ (authors: L. A. Lyusternik and Ye. K. Isakova), 
is devoted to real numbers, the arithmetical linear continuum, li- 
miting values, and to functions of one variable. The material of this 
chapter is more or less that which is usually called the introduction 
to mathematical analysis. 

Chapter II, “n-dimensional spaces and functions defined there” 
(L. A. Lyusternik), effects the transition from functions of one 
variable to functions of n variables, which, geometrically, corresponds 
to the transition from the arithmetical linear continuum to n-dimen- 
sional space E,, the fundamental theory of which is given. §1 is devoted 
to the fundamentals of n-dimensional geometry and, in particular, 
of the theory of orthogonal systems of vectors in E,, which serves 
as a simpler model for the theory (Chapter IV) or orthogonal systems 
of functions. §2 is devoted to limiting values in E,, to continuous 
functions of n variables and their systems (transformations in E,). 
In this chapter also §3 deals with a subject which plays an important 
part in pure and applied mathematics, the theory of n-dimensional 
convex bodies. 

Chapter III, “Series” (authors G. S. Salekhov and V. L. Danilov), 
consists of the theory of series and practical methods of summation. 

The theory of numerical series is dealt with in §1 including ques- 
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tions relating to infinite products, double series and the summation 
of convergent series. Side by side with the classical material the reader 
will find new results about the general tests for the convergence of 
series and estimations of the remainder. 

The more important classes of series of functions are considered 
in §2: power, trigonometrical, and also asymptotic power series, 
and their convergence. At this point some methods for the general 
summation of divergent series are added. In §3 are to be found various 
devices useful in calculations connected with the theory of series. 

Chapter IV “Orthogonal series and orthogonal systems” (authors 
A. N. Ivanova and L. A. Lyusternik), contains the general problems 
of the reduction of functions to orthogonal (and also biorthogonal) 
series. Here, also, general orthogonal systems of polynomials and 
the classical systems of Legendre, Chebyshev, Hermite Polynomials, 
and others, are considered. 

Chapter V “Continued fractions” (author A. N. Khovanskii), 
deals with that branch of analysis which occupied the attention 
of the greatest mathematicians of the eighteenth and nineteenth 
centuries, but which was afterwards unjustly forgotten. Continued 
fractions did not find a place in the contemporary larger courses of 
analysis; on the other hand comparatively recently, some elements 
of the theory of continued fractions were studied even in middle 
school. In the past few years the interest in continued fractions has 
revived in connection with their application in computation and 
other topics in applied mathematics. 

Chapter VI, “Some special constants and functions” (authors 
L. A. Lyusternik, L. Ya. Tslaf and A. R. Yanpol’skii), has more of 
the nature of a manual (in the narrow sense of the word). The mate- 
rial here concerns various constants, the most important systems 
of numbers, including Bernoulli and Euler numbers, some discon- 
tinuous functions, and the simpler special functions (elliptic integrals, 
integral functions, the gamma and beta functions, some Bessel 
functions, etc.), These functions, together with orthogonal polyno- 
mials, after the elementary ones, are the most widely used in appli- 
cations of mathematics. We would like to mention that these special 
functions will be dealt with more fully and in the complex domain 
in one of the following issues. 


CHAPTER I 


THE ARITHMETICAL LINEAR 
CONTINUUM AND FUNCTIONS 
DEFINED THERE 


§ 1. Real numbers and their representation 


1. Real numbers 


All real numbers can be split into two classes: rational and irra- 
tional, All integers and fractions (positive, negative and zero) are 
rational numbers, while the remaining numbers are irrational. 

The set of all rational numbers is everywhere dense, i.e. between 
any two distinct rational numbers a and 5b (a<b) there is at least 
one further rational number c (a<c<4), i.e. in fact, an infinity of 
rational numbers. 

Examples of irrational numbers are: J2 = 1-41421356..., a= 
= 3°14159...,e = 27182818... — the base of natural logarithms, andso 
on. Irrational numbers consist of algebraic and transcendental numbers. 
Algebraic irrational numbers are defined as all non-integral real 
roots of the algebraic equation 


XX +... +ApiX +n = 0, 


where a; (i= 1, 2,...,m) are integers; for example, the roots 
x = %/10, x = 3/3 of the equations *—10 = 0, x*5—8 = 0, the 
roots of the equation x5 — 3x4 — 2x3 + x?+ 1 = 0, andso on. The remain- 
ing irrational numbers are described as transcendental; examples 
of these are 2, e, e”, v2, log n (where 7 is any integer not equal to 
10*) and so on. 
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2. The numerical straight line 


We choose on a straight line £,, an origin of measurement — the 
origin of coordinates 0, a scale the unit of length, and a direction — 
the orientation. We associate with every real number x a point A(x) 
on the line £,, having the coordinate (abscissa). x, conversely, with 
every point A(x) on £,, we associate a real number x — its abscissa. 
E, is called a numerical straight line or a one-dimensional coordinate 
space (see Chapter II for n-dimensional coordinate spaces E,). 

The number 

_f-4@ for a<0, 
lel=| a for a=0 


is called the absolute or numerical value of the number a. 
The following relationships hold: 
ja+b| s|al+|d|, 
ja—b|=||a|—|d||, 


ab] =|a].[b}, 
2|_ lel 
by} [bl 








The number [a—)] is called the distance between the points a and 
b on the straight line £, (see Chapter I, § 1, sec. 1). 


3. p-adic systems 


Every real number is expressible as a decimal fraction, i.e. has a 
definite expansion in the decimal system of numeration. The decimal 
system is a particular case of a positional system to the base p, where 
any positive integer p > 1 can betaken as the base. The numbers 
0,1, 2,..., p—1 are called the digits of this system, while p* 
(k = 0, +1, +2, ...) are units of the kth order in the system. 

Every positive integer N is uniquely expressible in the form 


n 
N = aop°+a,p'+...+a,p" = > a;p', (1.1) 
ind 
where a; are digits. Equation (1.1) is written as 


N = QpQn—1Qn—2 +. - Ap. (1.1) 
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Similarly, any positive real number S, rational or irrational, is 
expressible as a fraction to the base p: 


n 


S= x a,p*, (1.2) 
k=—co 
which is written as 
S = Andy, - Ay, A-jA_pA_g.... (1.2’) 


If Sis an irrational number, it is uniquely expressible by an infinite 
non-periodic fraction to the base p of the form (1.2) (or (1.2’)). 

If S is rational, it is expressible as an infinite periodic fraction to 
the base p, e.g. the number S = 1/6 is written in the decimal system 
as 


S = 0°1666... = 0°1 (6). 
In the binary system, S = 1/6 is expressed by the infinite fraction 
1 1 


S = 00010101 ... = 00 (01) = stat i 


Rational numbers to the base p are numbers expressible as fractions 
with denominator p* (k = 1, 2, —2°...); each such number has two 
forms in the system to the base p: one with 0 repeated, the other 
with p—1 repeated. 


| aera : : 
For example, the number S = 3 is written in the binary system as 


S = 0°1000 ... = 0°1 (0), 
S=0O0111... = 00(1); 
and in the decimal system as 
S = 0:5000 ... = 0°5 (0), 
S = 0°4999 ... = 0°4(9). 
Having selected one of these forms for rational numbers to the 
base p, say the first — with 0 repeated, we obtain a unique form for 


rational numbers to the base p as infinite periodic fractions to the 
base p, and at the same time a unique form for every real number. 


The elements of various p-based systems were to be found in antiquity in diffe- 
Tent nations, and traces have been preserved into modern times in certain 
languages, e.g. of p = 12 (dozens and grosses), p = 20 (traces of this system have 
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been preserved in French), p = 40 (“forty times forty” refers to number of chur- 
ches in Moscow (Trans.)), etc. The system to the base 60 was well developed; it 
originated in ancient Babylon (traces are retained in measurement of angles and 
time). The 60-base system must have competed with the decimal in the Middle 
Ages in the Near East and Central Asia. The decimal system originated in 
India, was further developed in Central Asia, and passed from there into 
Europe. 


At the present time the binary system is widely used in computers 
(together with the related systems having powers of two as base: 
p = 2k, k > 1 an integer). A system of numeration to the base three 
is used in the Moscow State University “‘Setun”” computer. A set of 
numbers different from 0, 1, 2, ..., p—1 is occasionally used for 
the p digits of the system to the base p. For instance, a convenient 
choice of digits in the system to the base 3 is —1, 0, 1. The digits 
-1 and 1 can be used in the binary system. 


Non-homogeneous positional systems are more general; here, the ratios of 
units of different orders are different numbers. Such systems were used (before 
the introduction of the metric system) for representing ‘‘denominate” numbers, 
i.e. for representing magnitudes such as length, weight, etc. For example, the 
following system of units was used for measuring weight in pre-revolutionary 
Russia: 1 pud (= 16 kg) == 40 funtov, 1 funt (= 400 g ) == 32 lota, etc. 


4. Sets of real numbers 


We shall discuss various sets of real numbers — for example, the 
set of natural numbers: 1, 2, 3, 4,..., m,..., the set of all proper 
fractions, the set of all rational numbers, the set of all real numbers 
between 0 and 1, etc. 

The numbers are called the elements of the set in question. 


One can consider sets of elements of any kind, and not merely sets of real 
numbers. For instance, the set of points of a plane, the set of trees in a district, 
etc. The elements of these sets are respectively points of a plane, trees, etc. 


Sets are denoted in this book by capital letters: M, N, A, B, X, 
Y, etc., or by the symbol {x,,}, where x, are the elements of the set 
(countable sets). The set of numbers satisfying the inequalities 
a<x<b (a, b are numbers) is called an interval and is written as (a, b). 
The sets of numbers satisfying the inequalities x<a, x>b, are called 
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infinite intervals and are written as (— , a) and (b, + «) 

respectively. The set of numbers x satisfying the inequalities a s x =b 

is called a segment (or closed interval), and is written as [a, b]. 
The sets of points x satisfying the inequalities 


asx<b, a=<=xsb, 


are called semi-intervals and are written respectively as [a, 5), (a, 5]. 

The infinite semi-intervals (—-, a] and [{b, +) are similarly 
defined. 

The interval (x—e, x+e), (€ = 0) is called an e-neighbourhood of 
the point x. 

If an element x belongs (does not belong) to the set X, this is written 
symbolically as x € X(x€ X or x¢ X). 

If all the elements of a set X are simultaneously elements of a set 
Y, X is said to be a subset of the set Y, and we write symbolically: 
X c Y. Otherwise, X is not a subset of Y, and we write this symbol- 
ically as ¥ © Y(or X ¢ Y). For example, 


FEO, 1, ala, 6), a€(a, 5), bE la, b); 


OG Dc), 1, 2E0, 1, @ d)cfa, d). 


The set M of all the elements that belong both to a set A and a 
set B is called the intersection or product of the sets A and B, and is 
written symbolically as 


M=ANB (M=AXB=A.B= AB). 
For example, 


©, n=|-7, 1]n@ 2, b=, dN 9 


and so on. 

The set M consisting of all the elements that belong either to a set 
Aor toa set Bis called the union or sum of sets A and B, and is denoted 
symbolically by 

M = AUB (M= A+B). 
For example, 


(0, aul +=)=©, +e), (—3, 7]U(5, 8] = (—3, 8}. 
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The set M consisting of the elements of a set B that do not belong 
to a set A is called the complement of the set A with respect to the set 
B or the difference between the sets A and B, and is written symboli- 
cally as 

M=B\A (M = B-A). 
For example, 


(7, 8} = (5, 8\(—3, 7h, 2N [°. z) es E 2) etc. 


The notation B\A is employed in more general cases. 


5. Bounded sets, upper and lower bounds 


A set X of real numbers is said to be bounded from above (below) 
if there exists a number M (m), not less (not greater) than all the 
numbers x € X. The number M (7m) is called an upper (lower) bound 
of the set X. 

A set X is said to be bounded if it is bounded from above and below. 
For example, the set (—o, 0) is bounded from above, the set 
(0, +) bounded from below, while (0, 1) is a bounded set. 

The least (greatest) of all the upper (lower) bounds of a set YX is 
called the strict upper (lower) bound M* (m*) of the set X and is 
written symbolically as 

M* = supx (m* = inf x). 
xe X xe xX 
The numbers M* and m* possess the following properties: 
(1) The inequalities hold for all x € X: 


M*2=x, m*sx. 


(2) Whatever the number « > 0, a number x, € X can be found 

for which, respectively, 
Xo= M*—e, xo Sm*+e. 
For example, 
sup x=0, inf x=0. 
x € (—90, 0) x € (0, x) 

(3) If the set X = {x} is bounded from above (below), it has a 

strict upper (lower) bound. 
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The concepts introduced below (§ 2, sec. 2) of strict upper and 
lower bounds of a function are particular cases of the strict upper 
and lower bounds of a set. 


6. The theory of irrational numbers 


Precise irrational number theories, due to Dedekind, Cantor and 
Weierstrass, made their appearance in the second half of the nineteenth 
century, inconnection with the critical consideration of the funda- 
mental concepts of analysis. 

Dedekind’s theory. 

The set of all rational numbers with all their properties is assumed 
given. The set of all rational numbers is divided into two classes A 
and A’. This division is called a section in the rational number domain 
if the following conditions are satisfied: 


(a) every rational number falls into one and only one of the sets 
A and 4’, 

(b) every number a of the set A is less than every number a’ 
of the set A’. 


The set A’ is called the upper class, and the set A lower; a section 
is denoted by A]A’. 

Sections can be of three types: 

(1) either there is no greatest number in the lower class A, while 
there is a least number r in the upper class 4’; 

(2) or there is a greatest number r in the lower class A, while 
there is no least in the upper class 4’; 

(3) or there is no greatest in the lower class, and no least in the 
upper class. 

We say in the first two: cases that the section is performed by the 
rational number r (which is the boundary between the classes A and 
A’), or that the section defines the rational number r. In the third case 
the section A|A’ defines no rational number; we say that a section of 
type (3) defines some irrational number «. 

For example, if all the numbers a = 0 are referred to class A, 
as also the numbers a > 0 for which a? < 2, while all the remainder 


are in class A’, the section A| A’ defines the irrational number fe 
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All real numbers can be ordered in the following way: two irrational 
numbers « and £, defined by the sections A| A’ and B|B’ respect- 
ively, are reckoned equal if the sections A |A’ and B| B’ are iden- 
tical, and conversely, if the sections A] A’ and B| B’ coincide, the 
respective irrational numbers are said to be equal. We say that 
the numbera > fif the class A wholly contains the class B, which 
does not coincide with A, anda > r, where r is any rational number 
of the class A. Hence only one of the following relationships is possible 
for any two real numbers « and 8 :a@ = 6, a =< f,a>B. 

If sections are performed as described above in the domain of real 
numbers, it turns out that there always exists for any such section 
A|A’ a real number accomplishing the section. This is the essence 
of Dedekind’s basic theorem. This property of the set of all real 
numbers is described by saying that it is complete or continuous. 

We can introduce for real numbers the concepts of the arithmetical 
operations and laws (addition, multiplication, division by a non-zero 
number, etc.). For instance, the sum of two real numbers « and £ 
is taken to be the real number y = a + f which satisfies the relationship 
at+b<y<a'+b’, where a, a’, b and b’ are all possible rational 
numbers satisfying the inequalities: a<a<a’,b<B<b’, 

All the other arithmetical operations can be similarly introduced, 
while retaining the fundamental properties. 

Cantor’s theory. We take all possible fundamental sequences (see 
§ 3, sec. 2) of rational numbers. A sequence of rational numbers, 
convergent to a rational limit, is fundamental. At the same time, there 
exist fundamental sequences of rational numbers which do not have 
tational limits, as for instance the sequence of decimal approximations 
{l; 1:4; 1°41; ...} of the square root of two. 

Two infinite sequences {x,} and {y,} are said to be equivalent 
or confinal if |x,—y,| tends to zeroas n + oo. This means that two 
equivalent fundamental sequences {x,} and {y,} can only have 
the same rational limit x as m—~ oo. All equivalent fundamental 
sequences of rational numbers are referred to one class — the equi- 
valence class, and the set of all fundamental sequences of rational 
numbers is divided into equivalence classes. 

There are two possibilities: either there exists a rational number 
r, the common limit as n + of all sequences {x,} of the same 
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equivalence class X, or there is no such number among all the rational 
numbers. 

We say in the first case that the equivalence class X defines the rati- 
onal number r; in the second case, we say that the equivalence class 
X defines an irrational number x (which is also regarded as the limit 
of the sequences of the class X as n+ oo), Every equivalence class 
defines a real (rational or irrational) number. 

Arithmetical operations may also be introduced for all real numbers. 
For example, the sum x+y.of two real numbers x and y» is taken 
to be the number which is defined by the class ¥+Y, where YX is the 
equivalence class defining the number x, and Y the equivalence class 
defining the number y, the sum X+/Y being understood as the class 
to which sequences of the form {x,+y,} belong, where {x,} is any 
sequence of X, and {y,} any sequence of Y. 

All the other arithmetical operations on real numbers may be simil- 
arly introduced. 

A real number x is said to be positive (x >0), if the corresponding 
equivalence class X contains a fundamental sequence of positive 
rational numbers not convergent to zero. 

The inequality «> 8, where xand £ are two real numbers, means 
that «—8 > 0. 

The concepts of fundamental sequence and equivalence class can 
also be defined on the set E, of all real numbers. It turns out that 
all fundamental sequences are convergent on E, (see § 3, sec. 2), 
so that any equivalence class on £, defines a real number — the 
common limit of sequences convergent to it. No new numbers can 
be obtained with such a completion of the set £,; in this sense, the 
set E, is complete. 

Thus the real number set £, is obtained as a result of completion 
of the set of rational numbers by the limits of all possible fundamental 
sequences.of rational numbers. This idea of completion has acquired 
great value in functional analysis. 

As regards other irrational number theories, we may mention, 
in addition to Weierstrass’s, A.N. Kolmogorov’s argument (see 
ref. 6, p. 269) and the axiomatic construction of the rea] numbers 
(see ref. 4, p. 157, and ref. 15, p. 180). 
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§ 2. Functions. Sequences 


1. Functions of one variable 


If we are given a set of real numbers X = {x}, and each number 
x € X is associated with a corresponding number y, where Y = {y} 
is the set of all such y, the function y = f(x) is said to be defined 
on the set X. The set X is called the domain of definition of the function 
J(x), and every number x € X the argument. The set Y is called the 
range of the function f(x). If the argument x is given, the value y = f(x) 
of the function is given. For instance, for the function y = x* the sets 
X and Y coincide with the real axis E,; for the function y = tan x 
the set Y is the whole of the real axis E,, while X¥ = E,—M, where 


M is the set of all numbers of the form 1+ ra (1 = 0, +1, +2,...); 


for the function y= x! the sets Yand X are the sets of natural numbers; 
for the function y = E(x) (the integral part of x), X is the real line 
£,, and Y is the set of natural numbers. For the function 


_-l for x<0O, 
sign x = 0 for x=0, 
1 for x>0 


the set X is the real line, while the set Y consists of three numbers: 
-1,0, 1. 

Any finite set of numbers {a,} (i = 1, 2, ..., m) can be regarded 
as a function, given on the finite set of natural numbers X < {1, 2, 
.. +, n} and associating with each of these numbers i the value of the 
function f(i) = a; (i = 1, 2, ..., m). 

The concept of a function has been subjected to wide generaliza- 
tion. X can be a set of arbitrary elements. A numerical function is 
said to be given on this set if a number /(x) is associated with every 
element x of the set. 

We shall consider in Chapter II functions defined on a set of 
points (or vectors) of n-dimensional space. The area bounded by a 
polygon, or its perimeter, can be regarded as functions defined on 
a set of plane polygons; physical magnitudes, such as the mass of 
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a body, its charge, etc. are defined on the set of corresponding physical 


bodies, etc. 
The elements of a set X, on which a function is defined, are occa- 


sionally called points. 


2. Upper and lower bounds of a function 


An upper (lower) bound of a function f(x), defined on a set X, is 
a number M(m) such that f(x) = M(f(x) = m) for all x € X. If this 
number exists, the function f(x) is said to be bounded from above 
(below) on X. A function, bounded from above and below on X, 
is said to be bounded on X. 


The least (greatest) of all the upper (lower) bounds of a function 
J(x) is called the strict upper (lower) bound M*. (m*) of the function 
and is written as 

M* = sup f(x) (er = inf fx). 
zex xe xX 
If there exists an element x (x,) of X, for which 
S(%o) = sup f(x) ( Sf) = inf Ie); 
xe Xx xEeXx 
then 
sup f(x) = f(%o) ( inf f(x) = fe ) 
xeEX xe xX 


is called the absolute maximum (minimum) of the function f(x) and 
is written as 


f(%o) = sup f(x) = max f(x) (fon = inf f(x) = min fi). 
xe Xx xes xex xex 


In this case, we say that f(x) attains its absolute maximum (minimum) 
at the point Xp, (x) 
Given the finite set a,, a,...,@,, we write 


ee {41, dg, ...5 An} ee {Oy Ogu css a,}) 
n 


for the maximum (minimum) of the numbers a, dg, ..., @y- 
For example, 


=0, minsinx= —1, max sinx=1, 
x€ (0, 00) X x€E, xe Ey 


max {4, 3, 7, 11, 8} = 11, min {4, 3, 2, 10, 17}= 2. 
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The following inequalities hold: 


(1) oP I(x) + i A) = au (f) +A), (1.3) 
inf f(x)+ inf f(x) S inf (f(x) +fh(>). (1.4) 
xex xe x xe xX 


If f(x), A(x) and f(x) +/(x) attain a maximum (minimum) on X, 
then we have 


ge I(x) + max AG) = pes (fOt+A), (1.3a) 
min f(x)+ min f,(x) s min (f() +40). (1.4a) 
xe X xe Xx xe xX 


The sign of equality holds in (1.3a) (or in (1.4a) ) when f(x) and 
J,(x) attain a maximum (minimum) at the same point. 
For example, 


max sin x + max cos x = 2 > max (sinx+cos x) = ./2. 
x€ Ey x€ Ey x€ Ey 


(2) If Y c X (the set Y is part of the set X), we have 
~ eee BO 
For example, 
max sinx = v2 max sinx = 1, 
we [o, « ] x€E, 


max (3, 11, 15, 8) = 15 > max (3, 11, 8) = 11. 
The following notation is often used, 
(fx) =a), (<a), SHsq, (X=, (Uf) 29) 


and similar ones, to denote the sets of points x for which the respective 
inequalities are satisfied (they are called Lebesgue sets). 
For instance, (x? < 2) is the interval (—./ 2, /2); (sin x = 1) is 


the set of numbers {ton Noa , where m is any integer. 
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3. Even and odd functions 


Let us consider functions defined on the real axis or on the segments 
[—a, a] and intervals (—a, a) (in general on a set M, symmetric with 
respect to the origin). 

A function f(x) is said to be even if f(—x) = f(x) for any x of 
its domain of definition, and odd if f(—x) = —/f(x). All even powers 
x2” are even functions, and all odd x2"*+! are odd functions. Other 
examples of even functions are cos x, |x|, and of odd: sin x, tan x, 
etc. 

A sum of even functions is even, and of odd, odd. The product of 
even functions is even; the product of an even number of odd functions 
is even, and of an odd number, odd. For example, sin x tan x is 
an even function, x sin x tan x is odd. The product (and quotient) 
of an odd and even function is odd. For example, |x| sin x is odd. 

A constant is an even function. 

Any function of an even function is an even function, e.g. e!*!, 
sin (cos x) are even functions. An even function of an odd function 
is an even function, e.g. cos (sin x). An odd function of an odd func- 
tion, is an odd function, e.g. tan (sin x). 

Any function f(x) is expressible as the sum of an even function 
Ff,(x) and an odd function f,(x): 


f(x) = A) +A@), 


where 


Ai) = 5 UI) ++, 


fle) = 5 f0)-f=91-C 


(C is a constant). 


4. Inverse functions 


Given two sets X and Y, each element x € X being associated with 
some element y = A(x) € Y, a mapping (or correspondence) A of 
the set X into the set Y is said to be given. 
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If y = A(x), y € Yis called the image of the element x € X, while 
x is the pre-image of y. 

If a unique element x € X corresponds as pre-image to each element 
y € Y, the mapping (correspondence) A is called a one-to-one mapping 
of X into Y. 

EXAMPLE 1. Let all the houses of a street be numbered by the 
integers from 1 to 80. We have a one-to-one correspondence 
between the set of houses and the set of the first 80 natural numbers. 

EXAMPLE 2. Let E’ be the set of all non-zero real numbers; one of 
the two signs + or — is associated with each number x € E’. We 
have a mapping of E’ into the set of signs consisting of two elements; 
the pre-images of the sign + (—) are all positive (negative) numbers. 

Let the sets X and Y be sets of the numerical axis E,; the mapping 
A = f(x) of the set X into Y is some function y = f(x), defined on 
the set X, with the domain of values Y. 

If the function y = f(x) is a one-to-one mapping of the set X into 
the set Y, we say that there exists for the function f(x) the inverse 
function x = ¢(y), which maps the set Y into the set X. The set Y is 
the domain of definition of the function x = ¢(y), while the set X 
is its range. 


EXAMPLE 3. y = sin x, x = arcsiny, X = | -5* 57]. 


EXAMPLE 4. y = tan x, x = arctan y, X¥ = |-3* 3a]. 


EXAMPLE 5. y = e (k #0), x = (I/k)logy, X= E,. 


5. Periodic functions 


A function f(x) is called periodic if a number w>0 exists such 
that, for any x, 
fx+o) = $0). (1.5) 
The number @ is called a period of the function f(x). If @, and 
@, are periods of f(x), @;+@, is also a period of f(x). 
The least of all such positive numbers w is called the Jeast period 
(or simply the period) of the function f(x). 
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THEOREM 1. If a continuous (see § 3, sec. 11) function f(x) is periodic 
and differs from a constant, then it has a least period wy > 0, and all 
its remaining periods are multiples of wy. 

For instance, when f(x)'= sin x we have w) = 22, when f(x) = 
=|sin x| the periodw) = 2, and when f(x) = E(x) (see § 2, sec 1) 
the period w, = 1. 


6. Functional equations 


A functional equation is an equation connecting different values 
of functions; we say that a function, for which such an equation 
holds, is a solution of the functional equation, or, that the functional 
equation is satisfied by it. 

EXAMPLE 6. Solutions of the functional equation 

Axt+y) =f) +f0) (1.6) 
include the linear functions 
S(x) =kx = (kK is a constant), 


It can be shown that they are the only continuous functions satisfy- 
ing this functional equation. 
EXamMPLe 7. Solutions of the functional equation 


F(X) -fO) j= AE+Y) (1.7) 


include the exponential functions a*(a = 0), these being the only 
continuous functions that satisfy this equation. 
Notice that periodic functions satisfy the functional equation 


S(x+o) = f(x). 
We can also discuss systems of functional equations. For instance, 
the pair of functions 
f(x) = sinx, 9(y) = cosy 
(and the pair of functions f(x) = 0, p(x) = 0) is the unique con- 
tinuous solution of the system of functional equations 
S(X+Y) = f(X)PY) + /0) 90), 
x+y) = P(x)P) —SO)fO), 
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if we required in addition that the functions be positive in the interval 


(0 37) and that the conditions f (+) = 1, (3) =0 be 
satisfied. 


7. Numerical sequences 


A function, defined on the set of positive integers, is called an infinite 
numerical sequence if for each positive integer n(n =1, 2, 3,...) 
there is a corresponding number x, — the n-th term of the sequence 
{x,} = {X1, Xq,.-.,X%_y -..}. The number min the expression x, 
is called the index (or subscript). We sometimes consider sequences 
{x,} where, in addition to the natural ee n can be zero or have 
any integral value. 

We shall say that, when m>n, the term x,, follows the term x, 
(x, precedes x,,), independently of the actual magnitude of the numbers 
x, and x,,. A sequence is regarded as given if a relation is known 
for forming the terms of the sequence. It is often possible to find 
an expression (formula) for the general term x,, of a sequence. 

EXAMPLE 8. Arithmetical progression 


Xy = at(n—1)a. 
EXAMPLE 9. Geometrical progression 
X_ = ag™—}, 
EXAMPLE 10. Decimal approximations to the numberz=3-14159...: 
X= 3; X= 31; x3 = 3-14; x, = 3-141; 
EXAMPLE 11, Let n=a,a,...a, be a given number in the decimal 
system, where @,, d:,...,@, are digits; then the numbers x, = 


=0-4,a,,...a, and y, = 0-a,a,_,...a, form numerical sequences 
when n = 1, 2, .... For example, when 


n = 15 we have x15; = 0-15; y,, =0-51. 
EXAMPLE 12. We decompose the positive integer m into prime 


factors 
nn = ph, pels... pile, pileerti |. . palatl 
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and define a sequence {x,} as follows: 
Xp = ph. ple... phe DyfarrtD ... po (twt1) 


with n = 1, 2, 3, 

For example, n = 18 = 21.37, x1, = 3.271 = 3/2. 

It is possible to discuss sequences of vectors, functions, etc., as well 
as numerical sequences. 


8. Upper and lower bounds of a sequence 


A sequence X = {x,} is said to be bounded from above by a number 
M if x,=M for all indices m. In accordance with the definition 
given in § 1, sec. 5, the number M is called an upper bound of the 
sequence {x,}. The sequence X = {x,} is said to be bounded from 
below by the number m, if x, = m for all n. The number m is called 
a lower bound of the sequence {x,,}. The sequence is said to be bounded 
if it is bounded from above and below. 

The least /*(greatest m*) of all the upper bounds M (lower bounds 
m) is called the strict upper (lower) bound of the sequence {x,} and 
is denoted, as before, by - 


sup x, = M* and _ inf x, = m*. 
n n 


The propositions of § 2, sec. 2, hold for the strict upper and lower 
bounds of a sequence {x,}. 


9. Maximum term of a sequence 


Given a sequence {u,} (k = 0, 1, 2,...), we sometimes want to find max u, — 
k 
the maximum term of the sequence {u,}, provided such a term exists; let us call it u: 


Y 


“a = max &,. 
R 


The subscript of the maximum term of {u,} is called the central subscript and 
is denoted by ». If the terms of {4} include several that are equal to yu, the greatest 
of the subscripts of these terms is taken as ». 

Ifu, = u,(x) are functions of x,x € X c E;, then» = v(x), w = u(x) are also func- 
tions of x. 

Exampte 13. Given the sequence {u,(x) = x*/k!} (k = 0,1,2, ...), the number 
(x) = E(x) =n, while the maximum term “(x)= x"/n! for non-integral x; if x is 
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an integer, x = m, then »(x) = m, while u(x) = u,_, = 4, For example, with 
x = 6 we have »(6) = 6, u(6) = u, = 65/5! = 65/6! 

EXAMPLE 14. Given the sequence {u,(x)=x*/(2k+1)!} (kK = 0 1, 2,...), the 
index of the maximum term is defined by the inequality 


2n(2n+1) = x S (2n+2)(2n+39), 


and, with fixed x > 0, the maximum term u, corresponds to the value n = E(x). 


10. Monotonic sequences 


A sequence {x,} = {x}, %2,...,X,} is said to be monotonically 
increasing (decreasing), if 


Xy<Xgp<Xyp<... < Xy<... 
ae ne at-8) 
and to be non-decreasing(non-increasing), if 
Xy EXyBxXyH...S%yB... 
4 2 eS i By SE eee i a9) 


Sequences of the form (1.8) and (1.9) are described as monotonic, 
sequences of the form (1.8) being monotonic in the strict sense (or 
strictly monotonic). For example, the sequences {x,,}, where 


1 1 
xX = 2— i 1 , xy = 5 —3n=1> xn = 2+5(—1) 
ons 4. zz 


are monotonically increasing in the strict sense; the sequences {x,}, 


where 
1 1 
BG era 
are monotonically decreasing in the strict sense; the sequence {x,}, 
where 


1 1 1 1 
4 = 1; Sp a ee ME Me ee 


is non-increasing; the sequence {x,}, where 
X%=0, xm=1, x3=2, x,=2, x5=3, x= 4,... 


is non-decreasing. 
All the above-mentioned sequences are monotonic. 
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11. Double sequences 


A double sequence {a,,,} is a function of a pair of integral subscripts 
nand m: to each pair of integers m and m there corresponds a number 
Qnm — the term of the sequence {a,,,}. 

EXAMPLE 15. {a,, = 1/(n?+m?)}(n, m= 1, 2, ...). 

If the numbers n and m are represented in the decimal system by 


N= ApApiy --+ Ay } (1 10) 


m= bpp eae b, 


(it can be assumed that n and m are represented by the same number 
of digits; this can always be arranged by putting a suitable number 
of zeros in front), we can form a double sequence {N,,,}, where 


N = Nam = 4nbnQn—1dp-1 «.. yd. (1.11) 


ExamPLe 16. If 2 = 103, m = 27 = 027, then Njo3 97 = 100 237. 

Conversely, we can associate with every integer N, represented 
by the right-hand side of (1.11) (ifthe number of digits (2k—1) in N 
is odd we put the digit a,,= 0 in front), a corresponding pair of 
integers m and m in accordance with (1.10). 

We thus obtain a one-to-one correspondence between the set of 
pairs of integers and the set of all non-negative integers. 

EXamPLe 17. Given the double sequence {a,,,} (n,m = 0, 1, 2,... 
it can be related thus to an ordinary sequence {by} (N = 0, 1, 2,...), 
when N = N,,,, we have by = ay, 

The double sequence {a,,,,} is said to be arranged as the ordinary 
sequence {by}. 

See Chapter III for the summation of double sequences (double 
series). 


§ 3. Passage to the limit 


1. The limit point of a set 


We call x» a limit point of a set X if there is at least one more 
point of X (different from x) in any e-neighbourhood of the point 
Xo (€ is any positive number). Alternatively, x, is a limit point of a set 
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X if an infinity of points of X is contained in any e-neighbourhood 
of x». A set may have no (or even infinitely many) limit points, 
which may or may not belong to the set. For instance, the set Y = 
={1/n}, where n = 1, has one limit point 0, which does not belongto 
the set; every point of any interval (a, b) (as also the points a and 5) 
is a limit point of the interval. 

THEOREM 2 (Bolzano-Weiestrass). Every bounded infinite set X 
of E, has at least one limit point. 

A set M is said to be closed if it contains all its limit points. 

For example, M = {0 oe a sae as = is a closed set; 

2° 3 n 

any segment [a, 5] is a closed set. 

A set M in E, is described as open or as a domain if any point 
appears.in M along with its e-neighbourhood. 

For example, any interval («, 8) is an open set; any system of 
intervals is an open set. 

The real axis is an open and a closed set; on the other hand, any 
semi-interval (a, 8], [a, 6) is neither an open nor a closed set. 

The complement of an open (closed) set M with respect to E, is a 
closed (open) Set. 

For instance, the complement of the open set (— ~, 0) U (I, 
+ co) is the closed set [0, 1}. 


2. The limit point and limit of a sequence 


The number x is called a limit point of the sequence X = {x,} 
if any e-neighbourhood of x contains at least one term x,, of X 
different from x (i.e. an infinity of terms of the sequence). 

A bounded infinite sequence X = {x,} has at least one limit point. 

The constant number x, is called a limit of the sequence {x,} if, 
given any number ¢ > 0, however small, there is a subscript N (depend- 
ing only on the choice of «) such that, for all n > N: 


|\Xn—Xo] < & 


We say in this case that {x,} has a finite limit x, and write lim x, = Xo, 
N=> co 
or that {x,} is convergent to x, and write x, > Xo. The sequence {x,} 


is said to be convergent in this case. This means geometrically that, 
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given any ¢ > 0, from some subscript N, onwards, all the points x, 
lie in the neighbourhood (x»—¢, x9+¢). In particular, x,, is described 


as an infinitesimal if lim x, = 0. A sequence that has no limit is 
T—> co 
said to be divergent. 


A sequence {x,}, having the property that, given any e < 0, there 
exists a subscript N such that |x,,—x,| < ¢ for allm>N,n=>N, is 
described as fundamental. 

A general criterion for the convergence of a sequence {x,} is: 

THE BOLZANO-—CAUCHY CRITERION. A necessary and sufficient 
condition for the sequence {x,} to be convergent is that it be funda- 
mental. 

We say that the limit of the sequence {x,} is equal to infinity, 

lim yz = ©, 
N—> co 
if, no matter how large the number K > 0, there exists N such that, 
for all n>WN, 
|X_| > K. 


If the numbers x,(m > N) are positive (negative), we write 


lim x, = + ao tem 
N-> co lh—> co 
Some limits: 
hk k= 1 
1. Ae wh SO RC Rc ee (b # 0). 
neo bnt+bnb-14 1... +b, Db 


n/~ ,njizp\n 
vs tim Wet VO" _ ap, 


n-> co 





=e {cf. (6.36)]. 


6 it ee ee 


@ 
n>eoVn+l(nt+2)...2n 4° 


me - 
7. tim LEW2+N3 + 1 +e 2g, 


N—> co n 
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8. For p> 1 

; n n \P n \P 1 

am {rte [[et) “(e+ Jt 
9. For a > 0. 

lim 12-1 9-14 32-1 qa-l eae +(- 1)?-1nt-1 > 0 

nt—> oo n 7 4 
10. If we write 

Aptay# «0. + 

An 2a and Gy_, = "Jaga, .-- Gn» 


we have, with a, = C®: 


lim 7/4, = 2, lim Y/G, = Je. 
N—> co N—> co 

11. If the above notation is retained for A, and G,, we have 
with a, = a+kd(k = 0, 1,2, ...),a>0,d>0: 


G, 
n 


2 
= 


3. Fundamental theorems concerning limits 


1°. A sequence can have only one limit. 

2°. If a sequence has a finite (infinite) limit, it is bounded (non- 
bounded). 

3°. If a sequence {x,} has a unique limit point xo, the sequence is 
convergent and Xz is its limit. Conversely, if a sequence (x,) is convergent 
to Xo, Xo is its unique limit point. 

4°. If x is a limit point of a sequence {a,}, there exists a subsequence 
{a,,}, convergent to x. Conversely, if y is the limit of some subse- 
quence {a,,}, y is the limit point of the sequence {a,}. 

5°. Similarly, if x is a limit point of a set M of the numerical axis 
E,, M contains a sequence {x,} of numbers different from x that con- 
verges to x. 


6°. On the assumption that lim x,, and lim y,, exist, we have: 
N—> co N—> co 


THE ARITHMETICAL LINEAR CONTINUUM 23 
lim (%, + Yn) = lim x, + lim yp, 
n— oo Nl—> co Rh=—> co 


lim (x,-y,) = lim x,. lim y,, 
nt—> oo N—> co Nl—> co 


x lim x, 
lim = = *==—., where lim y, ~ 0; 
n—> oo Yn lim Yn : aans ' 
nN—> oo 


4. Some propositions on limits 


1°. If lim a, = a and all the a, >0 (i = 1, 2,...), then 


N—> co 

F . Atat...+2a 

lim "/ajag...¢, = 0, lim + —?*-“—™ = 4, 
n—> co N-> 00 n 


2°. If A is the greatest of the numbers 


Gy, Any ooes a, (a, = 0) 
and 
pp>O0 i = 1, 2, 3, ..., 7), 


we have 
lim "“/pyat+ pray + ... + Pram = A, 
mMm=> co 


a a aad 2 le a 2 
m>co Pit" + Pedy +... + Pron 


3°. If, for a sequence {a,}, 


and 


both exist, then 
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4. If 


Pr 


lim — —-*———. = 0, 0, 
n-reo Pot Pit --+ +Pn ne 


and, asn + oo, S,, has a limit equal to s, we have 


lim SoPntS1Pn—-1t SePnoat +++ +5nPo _ r 
n=—> 0 PotPit Pet --- +Pn 


5. Upper and lower limits of a sequence 


The upper (lower) limit of a sequence {x,,} is the strict upper (lower) 
bound of the set numbers which are limits of the sequence, and is 
written as 

lim x, ( lim *n): 
Ree se n—> 00 


For example, 
im [c-or+t] Si 
N—> co n 


lim [m+] = 1, 


N-> co 


while at the same time, 


1 3 
sup [- +e => 


nel, 2,. 


inf [m+] = -l1. 
nwl,2,... n 

Every bounded sequence has an upper and a lower limit. 

If a sequence is convergent, its limit coincides with its upper and 
lower limits; if the upper and lower limits are the same, the sequence 
is convergent to their common value. 

Given any sequence that has an upper and a lower limit, we can 
readily form monotonic sequences convergent respectively to the 
upper and lower limits: a monotonically non-increasing {x,,,} to 
the lower, and a monotonically non-decreasing {x"} to the upper: 
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i = SUDA May Masa ade sche 


Xen 


it 


p01 ee PPO ee aE 


— : * : _ 4k 
lim x, = lim x;, lim x, = lim ey. 
Ni=> oo N—> co nue N—> co 


If {x,,} is a monotonically non-decreasing (non-increasing) sequence 


: bd iJ 
and a= lim x,, then x, = X,, Xe, = @(X, = 4, Xen = Xp): 
n-> oo 


6. Uniformly distributed sequences 


Let the sequence {x,} lie on the segment [a, 5]. 
Let N,, (x, 8) denote the number of the points x, (kK = 1, 2,..., m) 
which lie in the interval (x, 8) < [a, 5]. If the limit 


lim Mit Bg = pa 


n—> oo 


exists, then no matter what the interval («, 8) c [a, b], the sequence 
is said to be uniformly distributed on the segment [a, b]. 

EXAMPLE 18. The sequence {y,} of EXAMPLE I1 (see § 2, sec. 7) 
is uniformly distributed on [0, 1}. 

EXAMPLE 19. The sequence {x,}, where 


X_ = an?—[an?], a>0, O0<c0<1 (n= 1,2, ...), 


({x] is the integral part of x) is uniformly distributed on [0, 1]. 
EXAMPLE 20. The sequence {x,}, where 


xX, = a(lnn)’—[a(lnn)?], @>0,0>1 (n= 1,2, ...), 


is uniformly distributed on the segment [0, 1]. 

Uniformly distributed sequences have applications in numerical 
integration. Obviously, all interior points of the segment [a, 5] 
are limit points for {x,,}, and moreover, 


a= lim x, 5b= lim x. 
n=peo N—> co 


Given any function f(x) continuous on [a, 5], and a sequence {x,}‘ 
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uniformly distributed on [a, 5], the following relationship holds: 
. 1 2 1 
Bee ph (x) = a & dx. 
Conversely, if this equation is satisfied for all functions continuous 
on |[a, 5}, then the sequence {x,} is uniformly distributed. 


7. Recurrent sequences 


A sequence {x,} is said to be given bya recurrence formula if the 
first few terms are given and a formula is known, with the aid of 
which x, is expressible in terms of the preceding terms: 

Xn = SXn-1 Xana +++> nap) p=l(=1, 2,...). 
For instance, x, = 1, %2 = 2, x, = X,_1 = Xp,__ (nm = 3, 4, ...). 

The sequence itself is sometimes described as recurrent. 

The simplest example of a recurrent sequence is an iterative sequ- 
ence {x,}: 

Xn = S(%n-1)- 
Iterative, and in general recurrent, sequences are of great value in 
approximation methods — for example, in the method of successive 
approximations and Newton’s method. 

(a) The method of successive approximations for solving the equa- 
tion x = f(x), where f(x) is a continuous function, leads to an iter- 
ative sequence {x,}: 

Xh4+1 = f {x} (k = 0, 1, 2, oe ) 
where some arbitrary number is taken as x9. Here, if the sequence 
{x,} is convergent to x, x proves to be a solution of the equation: 
x = f(x). 

(b) Newton’s method (or method of tangents) for finding the roots 
of the equation f(x) = 0, where f(x) is a differentiable function, 
also leads to an iterative sequence {x,}: 

F'n) Xn —S(%n) ey 
he = Fay (K=0 1, 2,...), 
where some number is taken as xp; here, if {x,} is convergent, then 


lim x, = x is the required root, ie. f(x) = 0. 
k-> co 
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(See above, for a sufficient condition for the convergence of the 
sequence {x,} indicated in method (a).). 


8. The symbols o(«,) and O(@,) 


A variable that takes a certain sequence {«,} of values is called a 

variant. For instance, the variable term of any progression is a variant. 

If «, and #, are given variants, while their ratio «,/8, tends to 

zero as n > | lim «,/8, = 0); we say that«, (8,) is an infinitesimal 
Nn—> co 


(infinitely large quantity) with respect to 8, («,) and we write sym- 
bolically: 

&_ = 0(B,). 
For example, 1/n? = o(1/n), n = o(n?). 

If «,, B, are infinitesimals and «, = o(8,), we say that «, (8,) 
is an infinitesimal of higher (lower) order with respect to B, («,), 
or &,, (8,) decreases faster (more slowly) than B, («,). If «,, B, are 
infinitely large quantities, and «, = o(8,), we say that «, (8,) 
increases more slowly (faster) than B, («,). 

If |«, |= C|8,|, C>0 (C is a constant), we say that 8, has a rate 
of decrease not faster than x, or that «, has @ rate of increase not 
faster than B,, and we write symbolically: 


&, = O(B,)- 
In particular, if lim «,/8, = C #0, then «, = O(8,) or 


N—> co 
Bn = O (2). 
For example, n = O(V/n? +1). 
The equation 
by, = O(1) 
implies that the sequence {«,} is bounded, i.e. that |~,,| = C for all n. 
THEOREM 3. Given an arbitrary sequence {X,} = {x7} of the 
following sequences: 
Xe Stl Nay Kees, Kha ey 
Ng ed Xi AN, Mas ees eee 


CY 


Ce a i 
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there exists a numerical sequence X = {x,} = {%y) Xq--+>Xpo e+ s}s 
increasing faster (decreasing faster) than any of the sequences {x7,}. 

For example, if X, = {n™} = {n}, n?, n',...,™,...}, the 
sequence X¥ = {m!} = {1}, 2!, 3!,...,m!,...} increases at a faster 


tate than any sequence {X,}: lim n"/m! = 0 for any n. 
M-—> co 


9, Limit of a function 


Let the function f(x) be defined on some set X. We say that the 
number A is the limit of f(x) as x + Xp: 
A= lim f(x), 
x— Xo 
or that f(x) tends to A as x + Xo, if, given any sequence {x,} € X, 


convergent to x, ( lim x, = X9), the sequence {f(x,)} is convergent 
n—>e 
to A. Or, in other words, the number 4 is the limit of the function 


S(x) as x > Xo: 
A= lim f(x) (f(x) + A as x — Xp), 
x—-> xy, LEX 


if, given any positive number e, there exists 6 > 0 such that | f(x)— A |< 
<e for all x € X such that 0 < |x—x,)|< 6. For example, 


. sinx . tanx . l—cosx 1 
lim —=1, lim —2=1, lim —~—=-, 
x>o * zo * zo OX 2 


lim x°Inx =0O for any « > 0. 
x—>0 


10. Right and left continuity of a function 


We shall consider functions y = f(x), defined on sets X of E,; 
X will usually be a set such as 


[a, 5}, (a, 6), [a, b), («, 6), (- oo, + e), (- o, 0), 
[0, + eo), (- eo, 0), (0, + oo) > 
etc, 
Let f(x) be defined on an interval (xo, a). The number A =f(x,+ 0) 
is called the limit of the function f(x) from the right at the point x»=Xp 
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if, given any sequence {x,} of (xo, a), convergent to x9, f(x,) is con- 
vergent to A. We can similarly define at the point x = x, the limit 
from the left f(x»—0) = B of f(x), defined in an interval (b, xj). 
For example, we have for the function y = E(x) (see § 2, sec. 1) 
and for the integral argument x = n: E(n—0) = n—1, Em+0) = 20. 
When the argument x, = 0, the limits from the left and right of f(x) 
are written respectively as f(—0) and f(+0). For example, if f(x) = 
= sign x (see § 2, sec. 1), then f(—0) = —1, f(+0) = +1. 

A function f(x), defined at a point x = Xo, is continuous there 
from the right (left) if f(x9+0) [/(x»—0)] exists, equal to f(x). 


11. Continuous and discontinuous functions 


If 
S(X9—9) = f(%o +0) = f(%), (1.12) 


the function f(x) is said to be continuous at the point x = Xp. If f(x) 
is not defined in the interval (b, xo) or (Xo, a), the left- (or right-) 
hand term in (1.12) is ignored. (See also p. 59). If f(x), defined on the 
set X, is continuous at every point x € X, it is said to be continuous 
on the set X. 


For instance, f(x) = J) is continuous for all x = 0. 

Otherwise, f(x) is described as discontinuous. We say that (f(x) bas 
a discontinuity of the first kind or jump at the point x = Xp if f(xy) —0) 
and f(xo +0) exist, but (1.12) is not satisfied. In all other cases of a 
discontinuous function, the point x = Xp is called a point of discont-- 
inuity of the second kind. For instance, the function 


—1 for |x|<1, 
fo = 47 for |x| 21 
has a discontinuity of the first kind at the points x, = —1 and 


x2 = + 1. 

Certain commonly encountered functions y = f(x) are equal, 
at a point of discontinuity of the first kind x = x, to the arithmetic 
mean value 


S(%) = f(%o- 0) tio 0) . 
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For example, in the case of f(x) = sign x (see § 2, sec. 1): 


We say that f(x) is uniformly continuous on the set X if, given any 
é > 0, there exists a 6 = d(e) > 0 such that, for any pair of points 
x’, x” € X for which f(x) has a meaning, | x’ —x’’| < 6 implies | f(x’)— 
—f(x")| < e. Afunction f(x), defined and continuous on a bounded 
segment [a, 5], is uniformly continuous on this segment (Cantor’s 
theorem). 


12. Functional sequences 


An important role is played in analysis by functional sequences 
{f,()} (2 = 1, 2,...), defined on some set X of the numerical 
axis £,. Various definitions can be given of passage to the limit for 
such sequences, It is natural to start from passage to the limit at 
each point, when {f,(x)} becomes a numerical sequence for any 
fixed x € X. If the sequence {f,(x)} is convergent as n + oo for any 
x € X, its limit depends on the point x € X, i.e. is a function f(x) (a limit 
function), and this is written as 

SA) a> f) or lin ful) = f(x) xEX. 


EXAMPLE 21. 


-F for x<0O, 

lim arctan nx = + sign = 0 for x=0, 
N—> +00 - 

z for x>0. 


This example shows that the limit of continuous functions may be 
a discontinuous function. 

As a result of a double passage to the limit, functions can be 
obtained in the limit that have even more complicated discontinuities, 


for instance, 
lim lim (cos 2m! x)" = x(x), 


M—> co N—> oo 
where x(x) is Dirichlet’s function: 
1 if x is rational 
x(x) = ‘ peNghn ee 
0 if x is irrational. 
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REMARK. Together with functional sequences, we often encounter 
in analysis sequences of numbers, dependent on functions (functionals) 
For instance, the mean values of functions are defined by the limits 
of such sequences. 

If the function f(x) is integrable on [a, b] and f,, = f(a+v6,), 


b— 
6, = oe 5 then 


2 1 2 1 5 d 
lim 3 Sin = 5g | fo) ds 


n-> co 


is the arithmetic mean of f(x) on [a, 5]; 


: | 
slim Vfinlen San = P| — | fede } 


is the geometric mean of f(x) on [a, 5], and 


F n 1\-2 b dx \71 
linn (Sx) = 0-9 | 5) 


is the harmonic mean of f(x) on [a, 5]. 

The following also holds: 

THEOREM 4. If functions f(x) and g(x) are continuous and positive 
on [a, bj, then 


() tim | ” g(x) [FOI de = _max 03), 


| ” ex) Lfoyn? de 
(2) lim 23 = max f(z). 
nN co | g(x) LA" dx x€ (a, d] 


13. Uniform convergence of functions 


The concept of a uniformly convergent sequence of functions {f,(x)} 
plays an exceptionally important role in analysis. 

DEFINITION. A sequence of functions {f_(x)}, defined on a set 
X c £,, is said to converge uniformly as n + o to the function f(x), 
also defined on the set X, if, given any positive number «, an integer 
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N = Ne) can be found, independent of x € X, such that, for alln > N: 
\fr(x) —f(x) | < &. (1.13) 


If {f,(x)} is convergent as m + o at every point x € X, but does 
not satisfy the uniformity condition (1.13), we say that {/,(x)} 
converges non-uniformly to f(x) on the set X. With non-uniform 
convergence, the number N depends not only on the choice of «, 
but also on the number x € X: 

N = Me, x). 

THEOREM 5. Jf all the functions f,(x) of a sequence {f,(x)}, uni- 
formly convergent to f(x) on X as n—~ are continuous, the limit 
function f(x) is also continuous on X. 

It follows from this that, if the limit function is discontinuous, 
the convergence as n + co of the sequence {/,(x)}.is non-uniform. 

EXAMPLE 22. The sequence {f,(x)} = {x"} is uniformly convergent 
as n-—-+ oo to f(x) = 0 on any segment [0, g], 0 < q < 1; on the 
segment [0, 1] this sequence converges non-uniformly to the function 


0 for O0Osx<1, 
fey =} 4 for =1. 


FO +& 





Ye 





Fic. 1. 


Caucuy’s Test. A necessary and sufficient condition for a sequence 
of functions f,(x), defined on a set X C E,, to be uniformly convergent 
asn - o toa function f(x) is that, givenanye > 0, there exists an N, 
depending only on &, such that |f,(x)—f,,(x)| < € for all x € X, 
provided only that n > N and m > N. 
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Geometrical interpretation of uniform convergence. Let f(x) (n= 
=1,2,...) be continuous in [a, 5], and let the sequence {f,(x)} be 
uniformly convergent asm + oo to the function f(x), continuous in 
[a, b]. Now, all the curves y = f,(x) fall within an e-neighbourhood 
of the curve y = f(x) when n > N (see Fig. 1), i.e. they are contained 
in the strip between the curves y = f(x)—e and y = f(x)+e. 


14. Convergence in the mean 


A functional sequence {f,(x)} is convergent in the mean on the 
segment [a,b] C E, as n-~ o to the function f(x) if, given any 
é > 0, there is a number N such that, for all n > N, we have 


| ” LA) —fOP dx < 


(it is assumed that this integral exists). 
Use is often made of convergence in the mean in various branches 
of analysis (for instance, in the approximation methods of analysis). 
Convergence, defined by the norm of a space (see Chapter II, §1, 
sec. 2), is a generalization of convergence in the mean. 


15. The symbols o(x) and O(x) 


Given two functions x(t) and y(t), defined on a set_X, if their ratio 
x(t)/y(t) tends to zero as t+ a € X (lim x(t)/y(t) = 0), we say that 


t—a 


x(t) [)(t)] is an infinitesimal (infinitely large quantity) with respect to 
y(t) [x(t)] and we write symbolically: 


x(t) = o((¢)). 


For example, #2 = o(sint) as t+0, t" = o(e') as t + © for 
any n > 0. 

If x(t) and y(t) are infinitesimals as ¢ ~ a, and x(t) = o(y(t)), 
we say that x(t) ((t)) is an infinitesimal of higher (lower) order 
with respect to y(t) (x(t)), or: x(t) (y(t)) decreases faster (more slowly) 
than y(t) (x(t)). 

If x(t), y(t) are infinitely large quantities as t + a, and x(t)= o(y(t)), 
we say that x(t) (y(t)) increases more slowly (faster) than y (t) (x(t)). 
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If | x(t)| = C|y(2)| (C.is a positive constant), we say that x(t) does 
not decrease at a faster rate than y(t) or that x(1) does not increase 
at a faster rate than y(t), and we write symbolically: 


x(t) = O((0). 
For instance, t = O(tsin(1/t)) and t = O(tan 2f) as t > 0, 


1 
é= oles ‘ and et = O(eM##1) as t+ oo. 
In particular, if lim x(#)/y(t) = C + 0 (C is a constant), then 
ta 


x(t) = O((t)) and y(t) = O(x(2)). 


THEOREM 6. Whatever the sequence of functions f,(x), defined in 
‘the neighbourhood of a point x = a, there always exists a function 
g(x) € M, decreasing (increasing) faster then any of the f,(x) asx — a. 


16. Monotonic functions 


A function f(x) is described as monotonically non-increasing (non- 
decreasing) on a set X (e.g. on [a, 5)), if, given any points x,, x, € X 
such that x, < X_, we have f(x,) = f(x2) (f(x;) = /(x,)). A function 
J(%) is said to be monotonically increasing (decreasing) in the strict 
sense (or to be strictly monotonic) if f(x;) < f(%_) (f(x) > f(%2)) 
for any x,, X, € X for which x, < Xp. 

Functions monotonically non-increasing, monotonically non- 
decreasing, and strictly monotonic are all described as monotonic. 

When f(x) is monotonic, it always has limits from the left and 
right at a point of discontinuity x = x; if f(x) is non-increasing, we 
have 


S(X%o— 0) = f(xXo) = f(%o+ 0); 
if f(x)is non-decreasing, 
I%o— 9) S fl%o) = f(%o +9). 


Let y = f(x) be a monotonically increasing (decreasing) continuous 
function, defined in a segment interval or semi-interval X¥ € E,, and 
mapping X into a segment, interval or semi-interval YcE£; 
an inverse x = g(y) of f(x) now exists, defined on Y. The function 
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y(y) is continuous on Y and is monotonically increasing or decreasing 
along with f(x). For example, the function y = x? in the semi-interval 


(0, +) has an inverse x = Vy in (0, +). 


17. Convex functions 


A function f(x), defined on a set X (a finite or infinite interval, 
semi-interval, segment) is described as convex if, given any numbers 
X1, X_ € X, we have 


1 
(BP) = pied —Sook 
(x) is described as concave if the reverse inequality is satisfied: 
- 1 
s( AZ) = Ue) —fe. 


This means geometrically that, if f(x) is convex, no arc of the curve 
y = f(x) lies above the chord subtending it, whereas if (x) is concave, 
no arc of the curve y = f(x) lies below the chord subtending it. 

For example, the functions |x|, x?, e*, x-+|x| are convex, while the 
functions — |x], Vx, —e-*are concave; thefunction y = x*(x > 0) 
is convex « = 1 and a < 0 andconcave for 0 <a < 1. A necessary 
and sufficient condition for a function f(x) to be convex on [a, b]is 
that, given any numbers x, x2, x3 satisfying a = x, < x, < x3 30, 
the following inequality holds: 


x, f(x) 1 
X_ fm) 1)=0. 
x3 f(xs3) 1 


If f(x) is continuous (even only from the right) and f(x) = x if(x- 
—h)+f(x+A)], it is convex. 





x 
If f(x) is monotonic in [a, b], } F() dé is a convex function. 
a 


It must be borne in mind that the graph of a convex function faces 
downwards, i.e. it is a concave curve in the accepted geometrical 
terminology. 
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Convex functions have the following properties: 


1°. A convex (concave) function f(x) is continuous at every point 
of its domain of definition. 

2°. If f(x) is convex, —f(x) is concave on the set X. 

3°. A convex (concave) function /(x), not equal to a constant on 
the segment [a, 5], cannot attain a maximum (minium) inside [a, d]. 

4°. If f(x) is convex (concave) on [a, 5], and /(x) is a linear function, 
where /(a) = f(a) and /(b) = f(b), then either f(x) < I(x) (f(x) < I(x)) 
at every point of (a, b), or f(x) = U(x). 

5°. A linear combination of convex functions with positive coeffi- 
cients is a convex function; in particular, the sum of a finite number 
of convex functions is a convex function. 

6°. If f(u) is a non-decreasing convex function, while u = 9(x 
is a convex function, f[(x)] is a convex function of x. 

7°. The inverse of a decreasing (increasing) convex function is 
a convex (concave) function. 

8°. If f(x) is convex on [a, 5], given any positive numbers p;> 0 
(i= 1, 2,..., m) such that p;+p.+...+p, = 1 and any points x, 
Xp, ++) X, On the segment [a, 5], we have 


S(DiX, + PoXnt ++ +PnXn) S PiS(%1) + Pofl%q)t+ --- +Paf(%n). 


9°. Any convex function f(x), satisfying the condition f/(x,) = 0, is 
expressible in the form 
eo 


fs) = | rit) dt, 
Xo 
where p(t) is a non-decreasing function, continuous from the right. 
A function 9(x), defined on a set X Cc Ej, is described as logarithm- 
ically convex if log p(x) is a convex function, i.e. if 


x, —x. 
(AT) = eer 
for any x, x, € X. Alogarithmically convex function is a convex func- 


tion. For instance, the function g(x) = x log x is logarithmically 
convex for x >0; 9(x) = e** is logarithmically convex for all x € 
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E(—-, + 0); p(x) = x* (kis an integer) is logarithmically convex for 
x€(—oo, +.) and even k #0, for x€(0, +) and any k ~ 0; 
I(x) = fle! dt is logarithmically convex for x > 0 (concerning 


0 
the function I(x), see Chapter VI, § 4, sec. 5). 


CHAPTER Ill 


n-DIMENSIONAL SPACES AND 
FUNCTIONS DEFINED THERE 


Introduction 


We considered in Chapter I functions ofa single variable as functions 
of a point of the numerical axis £,. Similarly, functions f(x, y) of two 
variables can be regarded as functions of a point of the plane E, with 
coordinates x, y, and functions f(x, y, z) of three variables as functions 
of a point of space £, with coordinates x, y, z. 

About the middle of the last century, coordinate space of n dimen- 
sions was introduced into mathematics, and functions of n variables 
came to be regarded as functions of a point of n-dimensional space. 
At the same time, various concepts of ordinary two- and three-dimen- 
sional geometry were generalized to n-dimensional spaces. 

This generalization proved to be not merely formal. Our geometrical 
intuition can be carried over to multi-dimensional entities, and the 
treatment in geometrical terms of the problems of analysis and algebra 
of n dimensions led to greater clarity. Geometrical intuition sometimes 
enables us to discover the facts in n-dimensional geometry, which can 
be interpreted as corresponding facts of analysis and algebra. 

In the present chapter § 1 deals with the theory of n-dimensional 
spaces, and in particular with the theory of orthogonal systems of 
vectors, which is an elementary analogue of the more complicated 
theory of systems of orthogonal functions, discussed in Chapter IV. 

Section 2 is devoted to passage to the limit, continuous functions 
and continuous (in the generalized sense) operators on them in n- 
dimensional space. It is directly related to Chapter I, in which we 
discussed the same topics for the particular case n = 1. 

Section 3 gives a treatment of one of the branches of n-dimensional 
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geometry —the theory of convex n-dimensional bodies, which, apart 
from its geometrical interest, has acquired importance in a number of 
applied mathematical problems. It should be remarked that no great 
simplification is obtained by confining the discussion of convex 
solids to three-dimensional rather than n-dimensional space; and in 
fact, it is precisely the theory of convex bodies in space of a large 
number of dimensions that has acquired practical applications. 


§ 1. n-dimensional spaces 


1. n-dimensional coordinate space 


An element X of an n-dimensional space E,, is defined as a set of 
n numbers X;, Xg, ..., Xq. It is written as X(x,, X2,..., X,) or X = 
=(X,, Xg,..., X,). The space £, is the set of such elements. 

Elements of the space £,, are treated in two ways: on the one hand, 
they are regarded as points with coordinates x,, Xo, ...; X,, on the 
other, as vectors with coordinates x,, X2, .. +) X, (n-dimensional vector 
space). We shall start by using the first treatment. 

There are various ways of introducing distance or a metric into 
the space E, (see, for example below, § 3, sec. 3). The most com- 
mon is the following (Euclidean) metric: the distance o(X, Y) between 
the points X(X,, Xa, «++» Xp) and Y (yy, yo.- +» Yn) Of E, is defined as 


the number 
n 
A(X, Y= / ¥ Oi-y*. (2.1) 
im} 


The space £, with a distance introduced in this way is called n-dimen- 
sional Euclidean space. 

Formula (2.1) reduces to the formula for the distance between two 
points in analytical geometry when n = 1, 2, 3. 

We write @ for the point with zero coordinates: 9 = (0,0, ..., 0) 
(the origin of coordinates). We have 





aX, 0) = | yx. (2.2) 


inl 
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The distance thus introduced has the following properties: 
(1) eX, Y)20, where o0(X, Y) = Oonly when X¥ = Y; 
(2) o(X, Y) = 0X, Y); 
(3) ofX, Y) S AX, Y)+o(¥, Z) 


(the triangle inequality). 
An attempt is generally made to preserve these properties in 
generalized concepts of distance. 


2. n-dimensional vector space 


The n-dimensional space E,, can also be regarded as a vector space. 
The operations of addition and multiplication by a scalar (number) 
can be performed on vectors in the plane E, and in three-dimensional 
space E. Every element X (x, Xo, ..., X,) of E, will be regarded as a 
vector with coordinates x,, Xg, .. +, Xp: 

The sum of two vectors X (x1, Xo, .. +» X,) and Y (j4, Ya, -- +s Yn) 
is the vector X+ Y of E,, with coordinates x,+y,, X.+Jas +++» XntVn: 
The difference X—Y is similarly defined. 

If A is a number (scalar), and X(x;, x2, ..., X,) is a vector of E,, 
AX denotes the vector of EF, with coordinates Ax,, Axa, ..., Ax. 
Vectors X and AX are described as collinear. Linear operations on 
vectors reduce to linear operations on their coordinates. 

The zero point 6 corresponds to the zero vector @ with components 
equal to zero. Obviously, X¥+6 = X, AO = 0. 

The vectors 


e,(1, 0, 0, ..., 0), e,(0, 1, 0, ..., 0), ..., e,(0, 0, ...,0, 1) 
or alternatively, 
(5, Sin... ijn - ++ Sin)s 
where 6,, is the Kronecker delta: 
0 for ij, 
tym | s for i=j 
Jd 
are called unit vectors. The following equation holds for any vector 
X = (Xy, Xgy oo 0g Xp)! 
X= y Xe}. 


i=l 
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The norm || X || of the vector X is the number 


Wx = [5 (2.3) 
i=l 


equal to the distance o(X, 9) from the point X to 6. 
The norm of a vector satisfies the conditions: 
(1) ||X|| 20, where {{X|| = 0 only when X = 6; 
(2) [AX] = 1Al XT: (2.4) 
(3) X+Y¥I] Ss IXIN+I VIL 
The distance 0(X, Y) between elements X and Y, introduced in 
accordance with (2.1), is the same as the norm of the difference be- 
tween the corresponding vectors 
A(X, ¥Y) = ||X—- YI. (2.5) 
The sphere S(Xo, r) in E,, of radius r with centre at X) is the set of 
points (vectors) X, for which 
OX, Xo) = |] X-Xll <7. 
If we introduce for sets in E, the notation introduced in Chapter I, 
§ 2, sec. 2, we have 
S(Xq, 7) = (0X, Xo) <7) 


3. Scalar product 


In analogy with the two- and three-dimensional case, the scalar 
or inner product of two vectors X(X,, Xq, .. +5 X,) and Y(y4, Yo, - + +s Yn) 
of EZ, is defined by the equation 


n 


XY = (XY) = Vo xy. (2.6) 
i=1 
The elementary properties of scalar products are: 
(1) XY= YX; 
(2) XX = ||X||? = 0. 


Caucny’s INEQUALITY. Given any two vectors X(x1, Xe «++» X,) and 
LO» Yor +++» Vn) Of Ens we have 


IXY] s IIXII IYI (2.7) 
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| xo = /> 3b ¥%. (2.7/) 
im} inl im] 


Equality holds in formulae (2.7) and (2.7') if and only if the vectors 
X and ¥ are collinear (i.e. if X = 6 or if Y = AX, i.e. if all the x; = 0 
or y; = Ax; (i = 1, 2,..., n)). 

The angle between two vectors. Let X(x;, Xa, ..., X,) and Y(y,, 
Joy + + +» Y_) be two vectors of E,, different from 0; the angle m between 
them is given by 


or 





xy 
cos p = ————_, 2.8 
?= Tell aie, 
In view of (2.7), |cos y| = 1. 
The projection of the vector X on to the vector Y is given in magnitude 
by 


xy 
——— = || x|] cos 9. 2.9 
When || {|= 1, the projection of vector X on to Yis equal in magnitude 
to their scalar (inner) product: 


XY = {|X| cos 9. (2.10) 


EXAMPLE 1. The magnitude of the projection of the vector X(x,, 
Xe, . ++; X,) on tothe unit vector e,(i = 1, 2, ..., m) is equal to the 
coordinate x; of the vector X. 


4. A linear system and its basis 


An n-dimensional vector space is a particular case of an n-dimen- 
sional linear system. 

A linear system L is a set of elements to which we can apply the 
operation of addition, i.e. the operation of finding a new element 
cé€Z from two elements a, b€ L, c = a+b, and the operation of 
multiplication by a real number 4, i.e. the operation of finding from 
an element a€Z and a number 4 an element d= Aa¢L. These 
operations have the following properties: 
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(1) (a4+b)+¢ = a+(b+o); 
(2) a+b = bdb+a; 

(3) Ada) = (Adda; 

(4) A(at+b) = da+db; 

(5) (A+Aj)a = dat+dAa; 

(6) l.a=a.' 


The system L possesses a zero element 6, for whicha+6 = a,0.a = 0 
for aé L. : 

Linearly independent elements. Elements x,, Xo, ..., X, Of a linear 
system are said to be Jinearly dependent if there exists a set of numbers 
Cy, Cay +» +» Cy, NOt all zero, such that 


CyXy + CoXy t+... +CyXn = 9; (2.11) 
if there is no such set of numbers, i.e. if (2.11) is satisfied only with 
CHO =...=c, = 0, 


the elements x,, x2, ..., x, are said to be linearly independent. 
EXAMPLE 2. On a plane, the vectors X, (1, 1) and X, (2, 3) are line- 

arly independent, while the vectors X,(1,1) and X; (3, 3) are linearly 

dependent (since 3X,—X; = 6). In three-dimensional space, the 

vectors Y, (1, 0, 0), Ye (1, 1, 0) and Y, (1, 1, 1) are linearly independent; 

the vectors Z, (1, 0, 0), Z, (2, 1, 1) and Z, (3, 2, 2) are linearly dependent 

since : 

Z,-2Z,+Z; =0 


A linear system is described as n-dimensional if it contains n line- 
arly independent vectors, and any 7+1 elements of it are linearly 
dependent. A linear system is said to be infinite-dimensional if it con- 
tains any number of linearly independent elements. An n-dimensional 
vector space is an n-dimensional linear system. 

The set of solutions of a linear homogeneous differential equation 
forms a linear system. In the case of an ordinary nth-order equation 
this system is n-dimensional; in the case of a partial differential equa- 
tion the system is infinite-dimensional. 

The basis of an n-dimensional linear system L,, is any set (e,, e2,..., 
e,) Of m linearly independent elements. 
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Any element | of the system L,, is linearly (and uniquely) expressible 
in terms of the elements of the basis: 


Tm xy + XQlgt 16. Xen; (2.12) 


the elements x,e; (i = 1, 2,..., ”) are called the components with re- 
spect to the basis (e;, €:,..., @,) while the numbers x, are the coordi- 
nates with respect to this basis. 

EXAMPLE 3. The unit vectors e, form a basis in n-dimensional vector 
space: 


e, = (1, 0, 0,..., 0), e=(0, 1,0,..., 0)... 
sees €n = (0, 0, ..., 0, D. 


An n-dimensional linear system can be regarded as an n-dimensional 
space, in which the elements of the basis play the part of unit vectors. 


Examples of n-dimensional linear systems. Linear systems of functions, for 
which addition and multiplication by a number are understood in the ordinary 
sense, are aften encountered in analysis. We shall quote some examples. 

(1) The (#+1)-dimensional system of polynomials 


P(x) = 3 ex 
k= 
of degree not higher than 2. The system of powers 
1, x, x7, 2.0, x%, 
can be taken as the basis, as also can any system of polynomials 


Po= i, Pix) = x+A, 


k-1 
Py(x) = x?+a9:%+0y0) --+5 Py(x) = 2+ Yo ay... 
ay n-1 
woe Pax) = x*+ Yo ayxt 
i=d 


(2) The system of homogeneous polynomials P, (x,, X2, -.., X,) of degree 
kin n variables x,, X2,...,X,; i.e. sums of terms of the form 


Goa. FPRt oo alte 


kyky.. kg 
where 


k,+k,+...+k, =k. 
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The basis of this system consists of all single terms of the form xt1x}+... xts 
of degree k = k,+k,+ ... +k,. The number of such single terms (i.e. the number 
of dimensions of the system) is 

(n+k~-1)! 


For instance, with n = 3, k = 3, the number of them is equal to 5!/3!2! = 10 
(the single terms are xf, x}x_, X2X3. X1X2) XXqXq, X~F, X}, XRXq, XQXG, X3). 


If a system L, has one basis (e,, e:, ..., €,), it has an infinite set 
of bases. Let (e}, ¢,,..., en) be another basis; then the elements 
e, of the old basis are expressible in terms of the elements e; of the 
new in accordance with 


n 
a= Y «5e5 G=1,2,..., 7), 
jai 
where the determinant |~,;|};7} # 0. An element /is expressible in 
terms of the elements of the new basis in accordance with 


n 

coe 

I= > X4ej- 
tel 


The connection between the coordinates x; and x; of an element / 
with respect to bases (e;) and (e;) is given by 
n 
x= Y ayxj he 1D) aicay. Bs (2.13) 
j=l 
It follows from what has been said that the elements of any n-dimen- 
sional linear system L, with basis (e,, é2, ..., €,) can be regarded as 
vectors of an n-dimensional space in which the elements e; of the 


basis play the role of unit vectors. We shall confine our attention 
to such spaces in the present chapter. 


5. Linear functions 


A linear function or linear formin E, is a function f(X) = f(x;, X2,...5 
x,), Satisfying the conditions: 


(1) AX+Y¥Y) =f(X)-/™). (2.14) 
(2) (AX) = Af(X), where 4 is any number. (2.15) 
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If f(e;) = y; for the unit vectors e; (i = 1, 2, ..., m), then 


AX) = fy yer =H Emer) = Eee 216 


The numbers y, are the coefficients of the linear form f. 
These coefficients can be regarded as the coordinates of the vector 
Y = (yr, Yor «++» Yn) Of E,; we now have from (2.16): 


f(X) = YX. (2.17) 


The linear function f(X) is equal to the scalar product of the fixed 
vextor Y with the variable vector X. We usually say that the function 
S(X) is generated by the vector Y. 

The scalar product XY is a bilinear function of X and Y: it is a 
linear function of X if Y is fixed, and a linear function of Y if X is 
fixed. 

We have the equation 


\| |] = max YX. (2.18) 


i.e. the norm of the vector Y generating the linear form YX is equal 
to its maximum value on the unit sphere || X|| = 1. 
Criteria for linear independence. The Gram determinant for vectors. 
Let 

Xi(Xin, Xign ~~ +> Xin) G@=1,2,..., 


be vectors of the space E,. From them we form the following 
determinant: 


NGG VEO! pM See Ee ae (2.19) 


Cr 


THEOREM 1. A necessary and sufficient condition for vectors X,, 
Xp, ..., X, Of E,, to be linearly independent is that 
A(X, Xo, ..., Xp) # 0. 


Gram’s determinant I'y, x,,..., x, Of the vectors Xj, X2 ..., Xm 
of £, is given by 
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(41%) (4X2) «-- (%iXm) 
(XoX1)  (X2X2) .-- (2X m) 


(XmX1) (XmX2) «+» (XmXm) 


Gram’s determinant has the properties: 

(1) Pxyxy ... xe = 9 

(2) A necessary and sufficient condition for linear independence 
of the vectors X,, X, ..., X,, is that 


Px, X,... Xm > 95 (2.21) 


Vx, X20... Xm = (2.20) 


(3) When m = 2”, 
Vxixy Pe: ied (4(%, Xy Cry Xn)F. 


See Chapter IV, § 2, sec. 3 for the Gram determinant for functions. 

Manifolds. Let X,, Xz, ..., X, be linearly independent elements 
of LE, (1s k <n). 

A set of elements X of the form 


k 
X= >» CiXy (2.22) 
isl 
with arbitrary real c, is called a k-dimensional linear manifold. 

A one-dimensional linear manifold, i.e. a set of elements of the 
form X = Ax, (x, # 6) is a straight line passing through 0 and x. 
Part of this straight line — the set of elements of the form X¥ = Ax, 
A> 0, — is called a ray. 

A displaced k-dimensional manifold or k-dimensional plane is a 
set of elements X of the form 


k 
X= Xt ¥ eX; (2.23) 
i<t 
with fixed and linearly independent X,, X,, .... X, and arbitrary 
values of the numbers c,, cy, ..., Cy. It is obtained by displacement 
of the manifold (2.22) along the vector X). A one-dimensional displaced 
manifold is a straight line: 

X= XottxX, (-~2<f< +), (2.24) 

We have for a straight line through the points X, and X,: 
X= (1-1)X, 4+ tx, (— co <f< + 0), (2.25) 
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The segment of the straight line joining points X, and X, is the set 
of elements of the form 


X¥=(1-0X,4+1%, Osts)). (2.26) 


An (n—1)-dimensional displaced manifold is called a hyperplane. 
Any hyperplane is given by an equation (i.e. is a set of points X(x;, 
Xg, .+++) X,), Satisfying the equation) 


n 
YX¥ = y IjXj = d, (2.27) 
jul 


where YX isa linear form generated by the non-zero vector Y (),, yo, 
. ++ Dy). Conversely, every such equation defines a hyperplane. 

In general, any k-dimensional linearly displaced manifold (1 = k < n) 
is given by a system of equations 


n 
YX = y JipXy = d; (i = 1, 2, wees n—k), (2.28) 
j=l 


where the vectors Y; ( Yi, Vigo -- +> Vin) (i = 1, 2, ...,"—k), generating 
corresponding linear forms, are linearly independent; in other words, 
every such manifold is given by n—k linear equations. Conversely, 
n—k equations (2.28) (with linear independence of the vectors Y,) 
define a displaced k-dimensional manifold. If all the right-hand 
sides d; = 0, we get a k-dimensional (non-displaced) manifold. 
In particular, the straight line (2.24) is given by n— 1 equations (2.28). 


6. Linear envelope 


The linear envelope of a set M of E,, is the least linear manifold 
containing M: in other words, the linear envelope of the set M is 
the set of all linear combinations of any finite number of elements 
of M, i.e. of elements of the form 


‘ 
Dux, XE M. 
ic) 


In particular, if X,, Xo, ..., X; are linearly independent elements of 
E,,, their linear envelope is the k-dimensional linear manifold con- 


N-DIMENSIONAL SPACES AND FUNCTIONS DEFINED THERE 49 


sisting of all elements of the form 


k 
i=1 

Notice that, if the vectors X;, Xj, ..., X, form a basis of the 
k-dimensional linear manifold E, of £,, we can supplement them by 
vectors Z,, Zo, ..., Z,_, in such a way that the vectors X;, Xz, ...,X, 
Z1, Zo ..+» Zp_» form a basis in E,. Let E,_, denote the linear 
envelope of vectors L,. Every element Y of E,, can be expressed (unique- 

ly) as 
Y= X+Z, (2.29) 

where 


k n—-k 
X= xy CX;€E, Z= = 4,Z; ¢ £, ~k 
i=l j=l 


Here, the space E,, is the direct sum of the manifolds E, and E,_,, 
this being written symbolically as 


E, = ExtEnon (2.30) 


X and Z in (2.29) are called the components of the vector Y in E, 
and Eek 


7. Orthogonal systems of vectors 


Two (non-zero) vectors X and Y are said to be orthogonal if XY = 0 
(ie. if cos y = 0). The vectors X;, X2, ..., X,, form an orthogonal 


system if they are orthogonal in pairs, i.e. 

X;X;=0 for ixj. (2.31) 
The vectors of an orthogonal system are linearly independent. If, in 
addition, ||X;|| = 1, the vectors are said to form an orthonormal 

system. In this case, 
0 for iy, 
VX = 3S 2.32 
ie ae . for i=j. 239) 


The unit vectors e,, é:, ..., €, form an orthonormal system. 
In n-dimensional space E,, there exists an infinite set of orthogonal, 
and in particular orthonormal, systems of m elements, but there are 
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no orthogonal systems of (+1) elements. A system of n orthogonal 
vectors in E, forms a basis in E,,, called an orthogonal basis. 

THEOREM 2. [f vectors e}, €,, ...,@,form an orthonormal system in 
E,,, any vector X of E,, is expressible (uniquely) in the form 


n 
X= ¥ xe, x, = Xe, (2.33) 
i=1 
n 
(xX? = y x;?. (2.34) 


ial 


The passage from unit vectors e, é, ..., e, in E, to another 
orthonormal basis e}, €, .--» @, in E, is called an orthogonal trans- 
formation. An inner product of vectors is unchanged in an orthogonal 
transformation, i.e. if 


k lid + ’ ul Ls s vv 
X= JV xeq= VY xe, Y= 2 ye = ¥ vie. 
=1 


ia] t=1 fey 
then 


n n 
XY =P xi = Tx. 
i=l] i=] 


In particular, the norms |] X|| = JVXX (see (2.34)) of all elements 
of E,, and the distance between any pair of such elements: o(X, Y) = 
= ||X—Y{||, are unchanged by an orthogonal transformation. 

In general, if vectors e}, €,, ..., €, form an orthogonal system, 
we have 

= Xe; 


X = 4 - Sse 3 2.33' 

% peers ihe; 11? 233) 
n n 

NXIP = D xe lfeslP= 2 wep. (2.34') 


In analogy with the theory of orthogonal series (see Chapter IV), 
the coefficients x; in equations (2.33) and (2.33’) can be termed 
Fourier coefficients. 
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8. Biorthogonal systems of vectors 


Two vector systems X;, X2, ..., X, and Yj, Yo, ..., Y, of £, 
form a biorthogonal system if 


XiY¥j;=90 for ij, XY; #0 for i=j. (2.35) 
Multiplying the vectors X; or Y; by constants, we can arrange that 
X;Y; = 1 (i= 1, 2, ..., ”) 


where the old notation is retained for the new vectors. In this case, 
every vector Z of E,, can be written as 


n 
Ze DXi = Zk (2.36) 
i=l 
or as 
n 
Z= X WX, i = ZY. (2.36) 
i= 


Given a system of n independent vectors X,, X,, ..., X, in E,, we 
can form a system of vectors Y,, Y2, ..-, Y,, such that the two systems 
{X;,} and {Y;} are biorthogonal. If 


Xi = iv ize +++» Xin) and Yi = Oy Vian «++ Yin)s 
formation of the system {Y,} from the system {X;} amounts to 


formation of the inverse || y;;||[j* of the matrix ||x;;||}j. (See 


Chapter IV regarding orthogonat and biorthogonal systems of 
functions). 
i 
EXAMPLE 4. Let X; = )' e (i= 1, 2, ..., m), where e; are unit 
j= 


=1 
vectors in £,; Y; = e;—e,,, (i = 1, 2, ..., n—1), Y, = e,. In this 
case {X;} and {Y;} are biorthogonal systems in E,,. 


9. The projection of 2 vector on to a manifold 


Let E, be a k-dimensional manifold in n-dimensional space E,, 
(1 = k < n). The vector X of E,, is said to be orthogonal to E,, (written 
as X | E,) if X is orthogonal to any vector Y of £,, i.e. 


XY=0 if. Yu. Ee. 
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A vector X, of E, is called the projection of the vector X on to E, 
if ¥—X, is orthogonal to E,, 


Xo = plz, X. (2.37) 
We have: 
X = Xy+(X—X), (X-Xo) L Ex, Xo€ Ep. 
when X€E,, to pr.p, X= X. 


If X€E,, pip, X = X. 
Any vector X of E, has a unique projection on to E,. 
If X, is the projection of the vector X on to E,, we have 


(1) WXIP = Xl? +N X—Xoll, (2.38) 
(2) WX-Y IP B || X-XolP, (2.39) 


where Y is any vector of E,, and equality holds only when Y = Xj. 
In other words, the minimum of || X—Y/||?, where Y is any vector 
of E,, is attained when 


Y= Xo = pt.p,X. 


Let Up # 6 bea vector of E,. We shall write E, for the set of vectors 
of the form tU,) (- ~< t<+o), ie. the straight line FE, = tU,. 
The projection of the vector X on to the vector U, is defined as the 
projection of X on to the straight line Fj, i.e. we have: 


_ (XU,)U, 
pr, Uo X= TU ll? (2.40) 


and in particular, if || U)|| = 1, then 
Ply X = (XU)U, = (||X|| cos UW, 


where q is the angle between the vectors X¥ and Up. 

Expansion (2.33) of a vector X into a system of orthogonal vectors 
6 =], 2, ..., ) implies the representation of X as the sum of 
its projections on to the e}. 

Let Xj, X2, ..., X, be orthonormal vectors in E,, (k < n); they 
form an orthogonal basis in E, — their linear envelope. We can 
supplement them by the vectors X,,; (= 1, 2, ..., m—k) such 
that the m vectors X; (i= 1, 2, ..., ™) form an orthogonal basis 


in E,. 
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Let X be any vector in £,; then 
R 
pr. X = S GNs 252%, 
i=1 


The sum of the first k terms in expansion (2.33) or (2.33') is the 
projection of the vector X on to the linear envelope of the first k vectors 
Xa 2e san) 

Let the vectors {X;} (i= 1, 2, ..., k< n) be orthogonal. Let 


n k 2 
us form all possible sums )° c,e;. The expression || ¥— ¥' c,e, || attains 
i=l iss] 


a minimum when c; = x;, where c, is the “Fourier coefficient”; 

c; = XX, for || X;,|| = 1, while in the general case c, = XX;/|| X; ||, 
TueoreM 3. Let {L;} (i= 1, 2, ..., k) form a basis (generally 

speaking, not orthogonal in E,), and X be any vector of E,,; then 














k 
prep X = yi d,L;, (2.41) 
jJ= 
where d; are given by the system of linear equations 
h 
ELL ae AE Sey eB); (2.42) 
j=1 


the determinant of which is the same as the Gram determinant I’. 
When k =n, the system (2.42) becomes a system for determining 
the components of the vector X with respect to the basis {L;} (i = 1, 
2,..+, 7). 


§ 2. Passage to the limit, continuous functions and operators 


1. Passage to the limit in »-dimensional space 


Let L,, be a linear system with a chosen basis, Every element X € L, 
is defined by its coordinates x1, xq, ...; Xn» X = (x1, Xo, .-., Xp): 
Let {X,} = {X,, X2, ...} be a sequence of elements of L,, where 
Xin = (Xmy> Xmgo ++» Xmn)- The element X = (4, Xe, ..., X,) of Ly 
is said to be the limit of the sequence {X_,} if 

x; = lim xm; (2.43) 


m—> co 
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(i.e. if all the coordinates of X are the limits of the corresponding 
coordinates of the terms of the sequence {X,,,}). We write convention- 


ally in this case 
X= lim X,, (2.44) 


M—> co 
and also speak of the sequence {X,,} converging to X. 

The coordinates of the elements {X,,} and X depend on the choice 
of basis in L,, but equation (2.43), i.e. (2.44) also, does not depend 
on the choice of basis in L,: if the coordinates of X,, tend to the 
corresponding coordinates of X in one basis asm — oo, this property 
will hold for any choice of basis. 

An n-dimensional linear system, in which passage to the limit is de- 
fined in the sense indicated, is called an n-dimensional linear space. 

In Euclidean, and more generally, in normed (see § 3, sec. 3) spaces, 
where the distance between two points, or the norm of a vector, 
is defined, passage to the limit (2.44) can be defined as fotiows: 
X= lm X,, if 


MN—> co 
lim o(X,, X)= lim ||X,—-%X|| = 0. (2.45) 
M—> co MN=—> co 


Condition (2.45) is equivalent to condition (2.43). Thus, if we define 
the distance between two points or the norm of a vector (§ 1, sec. 1 
or 7) in a linear space, and make use of the definition of limit in 
accordance with (2.45), no changes whatever are introduced into 
the meaning of passage to the limit in L,.f 

There will be no loss of generality if we consider in this chapter 
passage to the limit in Euclidean spaces E,,. 

As in the one-dimensional case (see Chapter I, § 3, sec. 2), we 
shall call a sequence {X,,} of E, fundamental if, given any «> 0, 
here exists N such that 

II Am — Xml <& 
for all m'> N, m> N. 

A necessary and sufficient condition for a sequence {X,,} to have 
a limit is that it be fundamental. 

The concept of limit point (point of condensation) for a set M < E, 
is an immediate generalization of this concept for E, : X is called a 


t This introduction of a distance is called metrization of Ly. 
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limit point of the set M c E, if it is the limit of some sequence {X,,,} 
of points of M different from X. 

An equivalent definition is: X is called a limit point of the set 
M if any sphere S(X, ©) with centre at X contains a point of M 
different from X. 

An analogue of the Bolzano—Weierstrass Theorem holds (see Chap- 
ter I, § 3, sec. 1). 

Every bounded infinite set in E,, has at least one limit point. 

An open set in E,, is a set U of points of E,, such that, if a point 
X belongs to U, there exists a sphere with centre at X contained in 
U. An open set is called a domain if any two points of it can be joined 
by a step-line, contained wholly in this set. 

Examples of a domain are as follows: on a straight line, a finite 
or infinite interval; on a plane, the interior of a circle, triangle, strip 
between two parallel straight lines, etc.; in three-dimensional space, 
the interior of a sphere, parallelepiped, cone, etc. 

An example of a domain in E, is a parallelepiped (a parallelepiped 
in £, is an interval), i.e. a set of points X(x,, X2, ...,X,), the coordinates 
of which satisfy the inequalities a,~ x,;< 6; (i= 1, 2, ..., n), 
where a, and b; are given numbers. 

The intersection of any finite number of domains is a domain. 

A boundary point of a domain Q in E, is a limit point of Q that 
does not belongto Q. The set of boundary points of Q is called the 
boundary of Q. A domain Q together with its boundary forms a 
closed domain (or body) in E,,. 

For example, the boundary of an interval (a, 5) consists of the 
points a and b, while the segment [a, b] is a closed domain; the 
boundary of a sphere S(X5, r) is the surface of the sphere, i.e. the 
set of points X for which 


AX, Xo) = _/¥ (x? =r. 
i=l 


A closed set in E, is a set in E, containing all its limit points; for 
instance, closed domains are closed sets. 

THEOREM 4. The complement in E,, of an open set (domain) is a 
closed set, and of a closed set an open set. 
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For example, the complement of the sphere (|| X|] < r) is the 
closed set (|| X || = r), the complement of theclosed sphere (|| X'|| = r) 
is the domain (|| X || > r). 


2. Series of vectors 


The laws for passage to the limits of vectors (points) of n-dimensional 
space E, are essentially the same as the laws of passage to the limit 
in E,; the generalization to the n-dimensional case of the theory of 
conditionally convergent series (i.e. series which are themselves 
convergent, while the series formed from the absolute values of their 
terms are divergent) is of some importance. 

A vectot series in E,: 


p> Xp = Xt Mt+-Xt ... (2.46) 
=1 


is defined like a numerical series. 
If X;, = (Xpy> Xho» ---> Xn)» Series (2.46) corresponds to the k 
numerical series 


2 Xp = Xt Xt Ait -.- (Gi=1,2,..., 2m), (2.47) 
=1 


the terms of which are the coordinates of vectors X,, i.e. of the terms 
of series (2.46). 


The partial sum S,, of series (2.46) is the sum of its first m terms: 
m 
Sm = 2 DCE), A Sanne >. Oe 
=1 


Series (2.46) is said to be convergent if its partial sums S,, are con- 
vergent aS m — oo to some vector S, the sum of (2.46): 


S= YX, = lim Sp. 
kewl 


M—> co 


The convergence of series (2.46) is equivalent to the convergence 
of all the numerical series (2.47). If S = (s,, 5, ..., S,,), then 


s= D0 xn (§= 1, 2 3, ovcy 7) 
k=l 
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Series (2.46) is described as absolutely convergent if the series of 
the norms of its terms is convergent: 


D Well. 
kel 


The absolute convergence of series (2.46) is equivalent to the 
absolute convergence of the numerical series (2.47). 

Series (2.46) is said to be conditionally convergent if it is convergent 
non-absolutely. We have Steinitz’s Theorem, which is a generalization 
of Riemann’s Theorem (see Chapter III, § 1, sec. 2). 

(1) Jf series (2.46) is absolutely convergent, its sum remains unaltered 
whenever the order of the terms is changed. 

(2) If series (2.46) is conditionally convergent, its sum can be altered 
or it can be made divergent by changing the order of the terms. 

(3) The sums of the series obtained by interchanging the terms of 
aconvergent series (2.46) entirely fill some k-dimensional plane, 0 = 
= k Sn (see § 1, sec. 5). 

For an absolutely convergent series, kK = 0; for a conditionally 
convergent series, k > 0. 

EXAMPLE 5. Let x, = (—1)*(1/k), and let s be an integer, 1 = s sn. 
Every positive integer m can be written in the form m= rs+k, 
where r is an integer, 1 Sk ss. Let X,, = X,,4, = X,¢,, where 
e, (k = 1, 2, ..., s) are unit vectors. 

By changing the order in the series Y Xin» We can now obtain as 


m 
the sum, any vector of an s-dimensional manifold E,— the linear 
envelope of the unit vectors e,, @, ..., &, (see § 1, sec. 6). 


3. Continuous functions of 7 variabies 


Functions of a point (vector) of n-dimensional space. Functions 
of n variables may naturally be treated as functions of a point (or 
vector) of n-dimensional space. Let each point X (x,, Xo, ..., Xp) 
of a set M in n-dimensional space E, be associated with a number 
S(X) = fOr, X25... X,)3 We now say that a function f(X) =f(%, 
X25. +X,) Of apoint (vector) X or a function of n variables — the coor- 
dinates of this point (vector) — is defined on the set M in E,. 
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The concept of passage to the limit is introduced for functions 
in E,, as for functions of one variable. 

Let f(X) be a function defined on a set M CE, and let A be a limit 
point of M. We say that f(X) tends to a number a when X¥ € M 
tends to 4A, if 


lim f(X,) = a. (2.48) 


for any sequence {X’,} of M, convergent to A. 
This is written as 


a= lim f(X). (2.49) 
X—> A(X €M) 


(if M is a domain and A an interior point, it has to be mentioned 
that X,, tends to A while remaining in JZ.) 

There is another definition of such a limit, equivalent to the above: 
(2.49) means that, given any e> 0, there is a corresponding n> 0 
such that, when 

O0<||X-—All=< and XE€M 
we have 


[f(X)—al < e. (2.50) 
Continuous functions. We take a function f(X) = f(x;, Xo, -- +s Xn) 
defined on a set Mc E,, and a point X (x,, x2, ..-, X,) of this set. 
We say that f(X) is continuous at the point X € Mif 
lim  f(%p) = f(X). (2.51) 
eM 


m—> co, Xp 


This definition is equivalent to the following: a function f(X) is 
continuous at a point X of a set M if, given any «> O, there exists 
7 = (e) such that, for all points X¥ € M lying in the sphere 


o(X, X) = ||X-X|| < 1, (2.52) 


we have 


| f(X)-f(X)| < «. (2.52’) 


A function that is continuous at every point of a set M is said to 
be continuous in M. 
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EXAMPLE 6. The function 


1 1 


vi-i1x1P pi-k 2 


i=l 


is defined and continuous at every point of the sphere || X||? < 1. 
A linear function f(X) (see § 1, sec. 5) can be defined as a function 
continuous in £, and satisfying the additive condition: 


A(X +) = f(X)+f(%)- 


Uniform continuity. A function f(X) = f(x, Xe, ..., X,), defined 
ona set Mc E,, is uniformly continuous there if, given any e > 0, 
there exists 7 > 0 such that, for any pair of points X,, X,¢ M for 
which 

AX, X2) = || X1—Xell < 0, (2.53) 


| (XD —f(%)| < «. (2.53’) 


The number 7 in (2.52) depends on « and on the choice of the point 
X, whereas in (2.53), defining the uniform continuity of a function, 
it depends only on e and not on the choice of the points X, 
and X. 

Every function, uniformly continuous on M, is continuous on M. 
The converse is not generally true (for example, the function 
1/J 1—]| X||?, continuous inside the sphere || X|| < 1, is uniformly 
continuous there). 

As in the one-dimensional case (see Chapter I, § 3, sec. 11), we 
have 

THEOREM 5. A function f(X) = f(x, Xe, ..-, X,), Continuous on a 
bounded closed set U, is uniformly continuous there. 

Maximum and minimum. A function f(X), defined on a set M, is 
said to be bounded from above (below) on M if there exists a constant 
C such that, for any point X¥ € M, 


KXYseC (f(XY2C). (2.54) 


A function is bounded in M if it is bounded from above and below 
on M. 


we have 
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If f(x) is bounded from above (below) on M, a number C(c) exists 
which is the strict upper (lower) bound of the numbers f(X), i.e. of 
the values of the function /(X) at the points M: 


C = sup f(X) (¢ = inf 4X) ; (2.55) 
XEM X€M 
If there exists in M a point X, at which 
S(Xo) = C = sup f(X), 
X€M 
the upper bound C is called the maximum of f(X) on M: 
C = f(Xo) = max f(X). (2.56) 
X€M 


Xo is called the maximum point for f(X) on M. 
Similarly, if there exists in M a point X, at which 


SX) = ¢, 
c= inf f(x), 
XEM 


twhere 


the lower bound c is called the minimum of f(X) on M, while X, is 
the minimum point for f(X) on M: 


e = f(X;) = min f(x). (2.57) 
XeM 


We say in this case that /(X) attains its maximum (minimum) on 
M at the point X, (X)). 

THEOREM 6. A function continuous on a closed bounded set attains 
its maximum and minimum in the set. 

Jump functions. We often encounter in problems of mathematical 
physics the following generalization of the concept of jump to a 
function of n variables. Let Q, be a domain in E,. We say that it 
is “inside” its boundary I’, while the domain Q, = E,—(Qi+T) is 
“outside” the boundary I’. We shall write A; and A, for the points 
of Q; and Q, respectively.t Let a function f (which may or may not 


ti and e are the first letters of “interior” and “exterior”. 
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be defined on I’) be given in Q;+Q,. Suppose that the limit of f(4,) 
[f(A,)] exists, when A, (A;) tends to the point A of the boundary I; 
we shall write here: 


f.(A) = lim f(A,). 
If f(A) # f,(A), we say that the function has a jump 


f(A) -fi(A) 


on passing through the boundary I at the point A from Q;, to Q,. 

EXAMPLE 7. Let us take a bounded closed convex domain Q; in 
£, with a boundary I (a smooth curve), and the domain Q, = F,— 
-—Q;-I’. Given an arbitrary point 4¢€E, we define a number 
a(A) > 0, measuring the angle under which the curve I’ is seen from A. 
(It is formed by the rays joining A to all the points of I’). 

For points A; € Q;, we have «(A;) = 2x; for points A, € Q,, we 
have 0 < a(A,) < 2, where a(A,) — 2 if A, tends to a point 4 € I. 
We have a(A) = x for points A of the boundary I. 

For the function f(A) = (A) at the point 4 ¢€ I’, we have f,(A) = 
=f(A) = < f(A) = 27; the jump f,(4)—f,(A) = —2. 

Functions depending on a parameter. Every function 9(%,, Xa, .++»Xm3 
ti, fa, ..., ¢,) can be regarded as a family 


{Sirts Pe ta(X1s Xo; 20'S 9 Xm) = (%1, Xo, wee Xm: ty, tos cory tr} 


of functions of m variables x,, x2, ..., X», each of which is defined 
by a set of 7 values of another group of variables t,, t,..., t, — called 
“parameters”. We shall confine ourselves to the case of a system 
{ f(x) = ¢(x, t)} of functions of one variable x, depending on one 
parameter ft; ¢ takes any value froma set T of the numerical axis £,, 
while every function f(x) is defined for x of the set X € E, (the 
general case of n parameters and m variables is investigated similarly). 
Let f) be a limit-point of T. If, given any ¢ and x € X, the function 
F(x) tends to f(x) as t + ty (¢ € T), we say that the functions f(x) are 
convergent on the set X to the function f(x). Given any x € X and 
any number 7> 0, we can find a number «, depending on 7 and 
x, € = &(n, x), such that 


lfi(x)~—f@) | < 7 (2.58) 
for 0< |t—t)| <e(t € T). 
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For example, let 7 be the interval (0, o), and ¥ = (0, 1]; the 
family of functions {f(x)} is convergent to f(x) on [0, 1] as t + Oif 





| @) Aa) =F, pe =x 
| () fe) = 400", fo) = & 


8. 2a _f 90 for O<x~<1, 

© f=" $=) 1 oe gay 

The convergence of {/(x)} to f(x) on X is said to be uniform as 
i to (t € T) if, given any 7 > 0, there exists « = e(), depending 
on 7, such that (2.58) is satisfied for all x € X when |t—t,| < (eno 
longer depends on the choice of x). In examples (a), (b), we have the 
case of uniform convergence, and of non-uniform in example (c). 

The following are properties of the uniform convergence of a 
family of functions {f(x)}: 

1°. If the family {f(x)} is uniformly convergent on X to f(x) as 
t+ ty (t € T), and {t,} is any sequence of T, convergent to to, the 
sequence of functions { f,(x)} is uniformly convergent to f(x). 

2°. If all the functions f{x) are continuous on X, their uniform 
limit is a function f(x) continuous on X. (See examples (a), (b). In 
example (c), the limit function is discontinuous, which points to the 
non-uniform convergence of {f{x)} to f(x).) 

3°. Let p(x, t) be a function of two variables continuous in the rectangle 
aexsa,bstsb,. On writing f(x) = 9(x, t) for t € [b, d,), 
(x) = 9x, by), we find that the functions f(x) are uniformly convergent 
to f(x) as t + by. 


4. Periodic functions of » variables. Manifolds of constancy 


Let E, (1 = k Sn) bea linear manifold in £,, and f(X) a function 
defined in E,,. We say that E, is a manifold of constancy for the func- 
tion f(X) if, given any X ¢ E, and any Y of E,, we have 


AX+Y) = flX). (2.59) 


For example, in the case of the function f(x+ y) of two variables 
x and y, the straight line x = — y is a manifold of constancy. For, 
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if we add to the vector (x, y) any vector (x9, —x,) of this straight 
line, the function is unchanged. 

Let us bring in the basis in E,, of elements Y,, Yo, ..., Y,3 Zi, Zo, ..- 
«+> Zp_p Where Y,, Y:, ..., Y, form a basis in the manifold of 
constancy £,. Every element X¥ € E, can be written in the form 
(see (2.29)) 


X = Y+Z, 
nok 
Yek, Z= ¥ 2Zi, 
i=1 


where 

K(X) = f%+Z) = f(Z). 
The function f(X) = f(Z) reduces to a function of n—k variables — the 
coordinates Z,, Z,, ..., Z,_, of the vector Z. 

A period of a function of n variables. A period of a function f(X), 
defined on £,, is vector (different from the zero 6) such that, for 
any X, 

(X+o) = f(X). (2.60) 


It follows from (2.60) that all the elements Y # 6 of a manifold 
of constancy of a function f are periods of f. A function f(X), having 
a period that does not belong to the manifold of constancy, is described 
as periodic. 

We shall confine ourselves to periodic functions that have no mani- 
folds on constancy. Notice that every periodic function has an infinite 
set of periods (in addition to w, every vector of the form kw, where 
k is any integer, is a period). 

THEOREM 7. If @ and w, are periods of a function f(X), their sum 
+), is also a period. 

If @, We, ..., Om are periods of f(X), any vector w of the form 


m 
o= > no, 
i=1 
where n, are arbitrary integers, is also a period. 

The periods @,, &, ...,@, form a system of fundamental periods 
of f(X) if all the periods of f(X) are expressible as linear combinations 
with integral coefficients of these periods and are not expressible as 
such linear combinations of a smaller number of periods. 
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EXAMPLE 8. Let us take f(X) = f(x, x2) = sin x, cos x, on the 
plane E£,. It has a system of two fundamental periods, namely, the 
vectors @w, (27, 0) and w, (0, 2%). We could also take as fundamental 
periods w, and w; = (22, 27) (in which case w, = w;—@)). 

THEOREM 8. A continuous periodic function of n variables, having 
no manifold of constancy, has a fundamental system of periods con- 
sisting of not more than n periods. 

EXAMPLE 9. Let , @2,...,@, be a system of linearly independent 
vectors in E,. Let us form the set A of all vectors (points) of the 
form 

n 
bs NyDj, 
tml 
where the n, are integers. (Such a set is called a net of integers in E,,.) 
We shall write o(X, A) for the distance from the point X € E, to 
the nearest point of A; o(X, A) is a function of X. It has a system 
of fundamental periods consisting of the vectors @,, @2,...,@,- 

EXAMPLE 10. A continuous function of a complex variable 
S(x+iy) = P(x, y)+iQ(x, y) (not equal to a constant) cannot have 
more than two independent periods (Jacobi’s theorem). 


5. Passage to ‘the limit for linear envelopes 


Let @;, a,,..., a, be linearly independent elements in E. We shall 
write L(a,, a,...,@,) for their linear envelope. If b,, by, ...,5, 
is another basis in the p-dimensional manifold L(q,...,a,), then 
Lyd, ba, +. +5 bp) = Ly (Q, 2, - ++ 5 Gp) ; 

Let us consider a family of vectors /,, continuously dependent on 
a parameter a, such that, when «, + x, a, + a(a,~«a,), the expression 
(lag — !a,)/(%2—2;) tends to a vector which we shall denote by dl, /dz. 
We shall assume that /, , and /,, are linearly independent whena, #a. 
Having chosen another basis in L,(I,,, /,,): 


we have 
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Assuming that the vectors /, and dl,/dx are linearly independent, 
we find that, as a,—-a, aa, then the plane L,(/,, J.) = 
=L(lo,> (lag—/a,)/(@2—%2) ) tends to the plane L,(/,, dl,/dx). 

Given similar conditions (assuming that the systems of vectors 
Lagi lags 23s lay where no two of the numbers a, a,...,a%, are 
equal, and of the vectors /,, di,/dx,...,d?l,/dx”, are linearly inde- 
pendent), we find that, asz,;+a(i= 1, 2,...,p): 


d dP-1 
jo ( er ge ge Be Gee: (1 Sales oes ir): 


Given a family of functions f,(x), dependent on a parameter a, with 
the same conditions and witha; ~ a(i = 1, 2,..., p), we find that 


Lifa(*)s fa(*) +--+ f.,(00)) tends to L,( S,(x), Of,(x)/Oz, ..., 


dP-1 f.(x)/Ox?-"), For example, as x; + & (i = 1, 2, ...), we have 


Bett a8, sicag C8) i Lg (O™ xe8= say KP Te%); 


L 1 1 1 
eae > 
P\ x—ay? x-a@,” " Xap 


os inet pore 1 
P\ x—a’ (x—a2)?? °°? (x—a)P}’ 
Ly (xe, x9, 2.2, x6?) + La(a%, x®In x, ..., x¢In™-! x), 


LA|x—%|, |x—-@y|) + L(|x—el, sign |x—a|). J 











Let Ag be an n-dimensional, matrix, Aj (i = 1, 2, ..., a) be its eigenvalues 
(simple for @ * 0), x,, the corresponding eigenvectors: A aXia = AjeXig» || X;. I] =). 
Suppose that & of the numbers A;, (i = 1, 2, .... kK”) tendasa@ ~ Oto the eigen- 
value A, of the matrix A,, while the eigenvectors x, (i = 1, 2,..., ) tend to 
the eigenvector x, of the matrix A, corresponding to the eigenvalue A,. The linear 
envelopes L, (x; ,,42,----,%, ) Now tendtothe linear envelope Ly (x1, X%2, ~~ - Xp) 
where x, with i > 1 are augmented eigenvectors of the matrix Ay : Agx;—Agy, = 
=X, (= 2,3, ..., hk) 


6. Operators from £,, into E,, 


Let Q bea set in E, (which can coincide with E, itself); we associate 
with every element X(x,, Xo, ..., X,) of @ an element Y()j, Vos +++» Ym) = 
= f(X) of E,,. We say in this case that an operator f is given from E, 
into E,,, Q being called the domain of definition of the operator. We 
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can also say that we have a mapping f of the set Q of E,, into E,, or 
that the operator f performs a mapping of the set Q from the space E,, 
into the space E,,. 


If 
Y= (1 yor -++s Vm) X = (Xy, Xa, + +s Xn), 
Y = f(x), (2.61) 
then 
Hii= F(X) = Si, XQr see, a (2.62) 


where f, is a function of variables defined in Q, formula (2.62) 
being the coordinate form of writing the operator f, and (2.61) the 
vector form. The functions f, (i=1,2,..., m) are called the components 
of the operator f, and we write 


f=(h fs as Sm 


Every set of m functions f,(x;, x:,...,*,) (i= 1, 2,..., m) 
of n variables defines an operator f from £, into £,,, where f= 
= (A: Sos oe Sm) 

An ordinary function f(x), x2, ..., x,) is an operator from E,, into 
E, (into the numerical axis). 

An operator /(X) is said to be continuous in Q if 


Xn X 


1 n—-oo 
X,, and X belong to Q) implies that 
Sky) ase M(*). 


The necessary and sufficient condition for the operator f(X) = (f,(X), 
IAX), « - +s S_(X)) to be continuous is that all the functions f{X) = f(x, 
Xp, «+ «) X,) be continuous in Q. 

For example, the functions 


Z, = Jl-xj—xf—3§ = JI—I1F1P, 
Lo => xy + X2 + X3 

yield an operator from E,(x,, x2, x3) into the plane E,(Z,, Z,), defined 

in the three-dimensional sphere || X||? < 1 and continuous there. 

Functions of a complex variable provide us with examples of operators 

from E, into E, (mapping of a plane into a plane). 
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The term vector function is occasionally used instead of operator 
from E, into E,,. An ordinary function of n variables (n> 1, m = 1) 
is called a scalar function of a vector variable; an operator from FE, 
into E, where n> 1, is called a vector function of a scalar variable or 
simply a vector function, and an operator from E,, into Z,,, where 
n> 1, m=> 1, is called a vector function of a vector variable. 

Let X¥ = X(t) be a given vector function, where ¢ runs over the 
numerical axis (or a segment of it), and let X be a point of £,,. The 
set of points of E,, of the form X(t) is called a curve or line in E,,. 

Linear operators. A linear operator (mapping) from E,( x1, Xay.0.) Xn) 
into E,,(1) Yar» ++» Ym) is an operator Y(X) satisfying the conditions: 

(1) ¥(X, +X) = ¥(%)+7(%)s 

(2) the operator Y(X) is continuous. 

It follows from conditions (1) and (2) that a linear operator is 
homogeneous: 


Y(AX) = AY(X). 
THEOREM 9. A linear operator Y(X), where Y = (yy, Yo, «+ +1 Vn)» 
X = (X%, Xg, .- +) Xq)y Aas the form: 


Vi = Ay XyHyXgt ... +QinXn G=1,..., 7), (2.63) 


ie. every coordinate y({X) of the operator Y(X) is a linear function 
of X = (Xy, Xa + +5 Xp)- 

Every linear operator Y(X) from E, into E,, is defined by a rectan- 
gular matrix 


A=|lej|l G@=_1,2,...,m; j=l, 2,..., m), 
Y= AX. } 
Conversely, every such matrix defines a linear operator from E, into 
E,, (in accordance with (2.63)). When m = n, a linear operator from 
E,, into E,, is defined by a square matrix A = |\a,,||p} 
Formula (2.63) is the coordinate form of a linear operator (transfor- 
mation) from E, into E,,. 


(2.64) 


7. Iterative sequences 


Let 
{Xn {NX os has Kas ects. GS Ga tags oes Sy) 265) 
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be a sequence of vectors in E,, the corresponding k numerical sequ- 
ences being 


{Xni} = {Xois X1is Xois oe } (i = 1, 2, eeny k). (2.66) 
The vector sequence (2.65) (or system (2.66) of numerical sequences) 
is described as iterative if 
Xn = S(Xn-1) (= 1; 2.3, 520,) (2.67) 
where fis an operator from E, into E,. If f = (fi, fe, . - +» f,), equation 
(2.67) may be written in the coordinate form as 
Xni = Ai(%n-1,1 Xn-1,29 +++ Xn-1, 8) (i= 1, 2,..., k). 
(2.68) 
On putting X) = (Xo1; oz: -- +» Xop), We can find successively from 
(2.67) or (2.68): 
XxX; => (X15 X29 se ey Xp) X, => (X15 X09, «+25 Xan), eee 


Relationship (2.68) is sometimes written as 


Xni = Sin Xnz ese Xn int Xn=1, 2 %n=1, i¢as e+ ++ %n=1, hk) 
(2.69) 
(When finding the ith component of the nth vector X,, use is made 
of the components X,), Xnq, - + +» Xn, j- already found.) 
EXAMPLE 11. K. F. Gauss considered a sequence of pairs of posi‘ive 
numbers {«,, 8,} (n = 0, 1, 2, ...) or of plane vectors, where aq, 
Bo are given (%) = By), and 


Snr +Py- 
a = =, Bn = VonBn: 


As n+ oo, the sequences {x,} and {8,} tend to a common limit 
a= lima, = lim 6, — the arithmetico-geometric mean of the num- 


n—> oo N-> co 
bers ao, Bo: 
7 
a = a(%, By) = 3G’ = 


J ) dp 
&o Jo ne ag — BB Po) , 
A 1 ae sin’ p 


EXAMPLE 12. Let us take the sequence of partial sumss, = 1+ 
+(x/1!)+...+(x"/n!) of the power series for e*. On writing a, = n, 
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Bn =(x"/n!) we have: (%, Bo, So) =(0, 1, 1). We get an iterative 
sequence (x, B,, 5,) of the form (2.69): 


x 
on = O_it1, Be = Bnoiz > 5, = Spit Bn. 


The formula provides a unified scheme for obtaining successively 
(Gns Bs Sp) (i.e. 5, also) for n=1, 2, 3,.... The unified passage from one 
term of an iterative sequence to the next term is very convenient for 
computation on programme-controlled machines. 

Iterative processes. We can generalize the concepts of § 2, sec. 6, 
to operators from E,, into E,. 

Let f be a continuous operator from E, into E,: 


Y=f(X), Y=. Yo -++, Wns X = (Xy, Xa «++ Xn), 
or, in the coordinate form: 
Yi, = Ail%q, Xa «+ +s Xn) (i= 1, 2, ..., ”). 
Let us investigate the equation 
X = f(X) (2.70) 
or, in the coordinate form, the system of equations 
X; = filXp Xo. ++ 5 Xp) (2.71) 
We form the iterative sequence of elements 
Xn Kp Nae: cence Kage test Xa c (Seais Kas, bay Mids 
where X (Xo, Xo2 - + +» Xon) is an arbitrary element of E£,, 
Xinei = S(Xm) (m =0, 1, 2,...), (2.72) 
and in the coordinate form 
Xie in = Siltimis ings 3 0s Mein) G=1,2,..., m. (2.73) 


If the sequence X,,, is convergent to X*, X* is a solution of equation 
(2.70). 


The solution X* is called a fixed point of the transformation Y= f(X). 
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8. The principle of contraction mappings 


We introduce a norm into the space E,, (see § 1, sec. 2). An operator 
(transformation) f from E, into E,, is said to be acontraction mapping 
if there is a constant g (0 < q < 1) such that, for any X, X,€ E,, 


NWAOD-FOO I = 94-11. (2.74) 


The following theorem provides a condition for the existence of a 
fixed point of the transformation Y= f(X), i.e. of a solution of equa- 
tion (2.70), and at the same time, a condition for convergence of the 
iterative process (2.72). 

THEOREM 10. (the principle of contraction mappings). If Y = f(X) 
is a contraction mapping (i.e. condition (2.74) is satisfied with q < 1), 
then: 

(1) there exists a solution X = X* of equation (2.70), i.e. a fixed 
point X* of the transformation Y = f(X); 

(2) this solution is unique; 

(3) whatever the initial approximation X, the iterative process (2.72) 
is convergent to the solution X*, 

X* = lim Xp. (2.75) 
M—> co 

(4) the sequence X,,, is convergent to X* as fast as the convergence of a 

geometric progression with ratio q, in fact, 


n 
WX*— Kall = Gs Kol (2.76) 


We shall mention some sufficient conditions for an operator to be 
a contraction mapping under different norms. It is assumed that the 
functions f,(X) = f,(x1, Xe, ..., X,) — the coordinates of the operator 
(X) — have continuous partial derivatives with respect to all the argu- 
ments. 

For condition (2.74) to be satisfied, (also the consequences of the 
theorem), it is sufficient that: 

(a) in the Euclidean metric, 


3% keel 2q<1; (2.77) 


daa j= OX; 
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(b) in the metric mip) (see p. 97), 


™ | OF(%y, Xe5 .++s Xn) 


sg;<1 (i= 1, 2,..., m). 


(2.77’) 


Application to the solution of systems of linear algebraic equations. 
Let us take the system of linear algebraic equations 


n 
n= 2 GjX; + Bj (2.78) 
j= 
or, in the vector form, 
Y = AX+B, (2.79) 
A= |lay|l, B= (By, ba, ..., dy). (2.80) 


Given any initial vector Xo(%o1, Xo2, - - -» Xon), We form a system of 
vectors Xo, Xy, Xo, .- 6 Xmy oes 


Xm = (Xm Xmas +++s Xmn)s (2.81) 


Xnay = 4Xm+B (m=0, 1, 2,..9 (2.82) 


where 


or, in the coordinate form, 
a . 
Xm+1,i = 2 QigXmj + 5; (i = 1, Q5- ah * n). (2.83) 
jJ= 


It follows from (2.77) and (2.77’) that a sufficient condition for con- 
vergence of the vector sequence X,,, as m — - to the vector solution 
X*(x}, Xg, .- +» X_,) of system (2.79) or system (2.78) is that 


n n 

(a) ¥ Yah =q<! 
i=1 j=1 

or 

ha . 

(b) X lagl= a <1 fe 1 Bien) 
j= 

(q=maxq; i= 1, 2,..., n), 


the accuracy || X*—X,,|| of the mth approximation X,, being defined 
by (2.76); in case (a) the norm is Euclidean, in case (b) it is Mn): 
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§3. Convex bodies in n-dimensional space 


The theory of convex bodies in n-dimensional spaces was developed 
by G. Minkovskii; it has found applications in numerous problems of 
analysis, geometry and number theory, and more recently in new 
branches of applied mathematics: in the theory of games and in linear 
programming. This theory provided the basis for developing the the- 
ory of n-dimensional normed spaces, the infinite-dimensional generali- 
zation of which plays an important role in analysis. 


1. Fundamental definitions 


A convex set in space E,, is one which contains, in addition to two 
points A and B of the set, every segment joining these points. 
Particular cases: a convex domain Q is a domain which is a convex 


set, a convex body Q is the convex domain Q together with its boundary 
I. Points of the domain Q are called interior, and points of I’ boundary 
points of Q. 

On a straight line, an interval is a convex domain, and a segment a 
convex body; on a plane, the interior of a circle or triangle is a convex 
domain and the circle and triangle (including their boundaries) are 
convex bodies; in three-dimensional space, the interior of a cylinder, 
sphere, cube are convex domains, and the cylinder, sphere and cube 
(including their boundaries) are convex bodies, the sphere and cube 
being bounded convex solids, and the cylinder an infinite convex solid. 

A closed convex set, lying in a k-dimensional plane and not lying 
in any (kK—1)-dimensional plane, is called a k-dimensional convex 
body (0= k Sn). A point will be described as a zero-dimensional 
convex body. (The empty set is also regarded as convex.) 

A convex body (set) may be bounded or unbounded (cf. the above 
examples). We can quote as an example of an unbounded convex body 
a half-space in E,, i.e. the set of points X satisfying the inequality 
(f{X = C), where f is a linear functional in £,, and C a constant; 
the whole of the space E,, and any hyperplane in it are examples of 
unbounded convex sets. 

The intersection of convex sets in E,, is a convex set, the intersection 
of convex bodies in E, is a convex k-dimensional body (k = n). 
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A convex polyhedron is a closed convex body — the intersection of 
a finite number of half-spaces. 

The convex envelope of a set M in E,, is the set Q of points X€ E,, 
expressible in the form 


U 
xX = Y AX (2.84) 
i=1 


where / is any integer, / = n, X, are arbitrary points of M, A, are arbi- 
trary non-negative numbers satisfying the condition 


EXAMPLE 13. The convex envelope of a pair of points A and B is 
the segment joining them; the convex envelope of three points not 
lying on a straight line is a triangle; the convex envelope of four points, 
not on the same plane, is a tetrahedron with vertices at these points. 

The convex envelope of a set M is the intersection of all convex sets 
containing M, or the least convex set that contains M. Every bounded 
convex polyhedron is the convex envelope of a finite number of 
points — the vertices of the polyhedron. 

Limit points. A point A is a limit point of a convex body Q@ if A 
is not an interior point of any segment belonging to Q. 

Every limit point of Q is a boundary point of Q; but not every bound- 
ary point is a limit point. For example, only the vertices of a polyhe- 
dron (polygon) are its limit points. In the case of a circle and sphere, 
all the boundary points are limit points. In future, a convex body will 
be taken to mean a bounded convex body. 

A convex body Q is the convex envelope of its limit points. 


2. Convex functions 


A function f(X) = f(x;, %2, ..., X,), defined in E, (or ona convex 
set Q of E,), is described as convex if, givenany X and ¥ of E, (of Q), 
we have 


A(*Z*) = pCO +re (2.85) 


(and concave, if the reverse inequality is satisfied). 
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A convex function also satisfies the more general inequality: 


S(l-)X+tY] s 1-N/MO+9%) (2.85’ 
for any ¢ € [0, 1]. 
(See Chapter I, § 3, sec. 17, for convex functions of one variable.) 
If f(X) is a convex function, co is a lower bound in E,, (in Q), the 
set of points of E,, (of Q), satisfying the inequality 
S(X) s ¢, 


with any C 2 Co, is a convex body (set). 


Exampce 14, On the plane E, (x,, x), the functions 
Ly, %2) = (| x1 |? +| pyre 
with p = 1 areconvex functions. As p> ~, f,(x;, x2) tends to the function f.,(;, X2) = 
= max({x,|, | x21) (see Fig. 2). The sketch illustrates the curves (x1, x;) = 1 


for different p. They all pass through the points A, (1,0), A, (0, 1), A; (—1, 90), 
A, (0, —1). 





The curve f..(x1, X2) = 1 is the boundary of the square with vertices A,, As, 
Az, Ag. 

The curves f, = 1, where J < p < ~, lie between these two curves. 

The curve f; (x,, x2) =1 is the circle of radius 1. 
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The figures f, = 1, bounded by these curves, are convex. When p<1, such 
figures are no longer convex. For instance, when p = 2/3, we get a figure bounded 
by an astroid. 


3. Convex bodies and the norm of a vector 


Let Q be a convex body in £,, having 6 as an interior point. Every 
point X of £, can be written (uniquely, when X # 6) as X = AX), 
where A> 0, X, is a point of the boundary of Q. If Xlies outside Q, 
then A> 1; if X liesinsideQ, A < 1;if X lies on the boundary of Q, 
A = 1. The point 6 can be written as 0.X (i.e. 4 = 0 for the point 6). 

We now define a function y Q(X) in £, as follows: at the point 
X=1X%, 

P(X) =A; 


PQlX) is greater than, equal to, or less than 1, depending on whether 
X is outside, inside, or on the boundary of Q respectively, 


Po(8) = 0. 


PQ(X) is a convex function. The body Q is the set of points of £,, for 
which ¢,,(X) = 1, while the boundary of Q is defined by the equation 
P(X) = 1. 

Pa(X) has the following properties: 

(1) P(X) = 0, where py = 0 only when X = 6; 

(2) Whend & 0, pg(AX) = Aga (X) (implying a positive homogeneous 
function); 


(3) Q(X+Y)= 9Q(X)+ Po (¥). 

If Q is a central symmetric convex body with centre at 6 (i.e. ¥¢€ O 
implies ~X € Q), we have the additional property: 

PAX) = Al goQ(X) for A<0. 

Property (2) becomes the stronger property: 

(2’) PQ(AX) = 1A] Q(X) 
for any real 4. If » is a given function satisfying conditions (1)-(3), 
the set Q defined by Q(X) = 1 is a convex body, while it is a centrally 


symmetric convex body with centre at @ when condition (2’) is 
satisfied. 
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The Euclidean norm || X’|| of the vector XY € E, satisfies conditions 
(1), (2), (3). We can generalize the concept of norm of a vector in 
n-dimensional space: the norm can be taken as any function ¢(X) 
that satisfies conditions (1), (2), (3). We shall write E, , for such a 
space. 

If || X]] = ~(X), conditions (1) - (3) can be rewritten as: 


(1) || X]| = 0, and {| X|| = 0 only when ¥ = 0; 
(2) When A> 0, we have ||AX || = A]| X]|; 
(3) [| X+Y¥ || = || X4 | | (the triangle inequality). 


When ¢ is even, condition (2) is replaced by the stronger one: 
(2’) ||AX|] = [A] || Xl (for any 4). 


Spaces E,, in which a norm is introduced, satisfying the above 
conditions, are said to be normed. For instance, Euclidean spaces are 
normed (see § 1, sec. 7). 


4. Support byperplanes 


Let us take the linear form f¥ = y i.x,in E,, the hyperplane 


(fX = C) and the half-space ({X¥ = C). We call ({X = C) a hyperplane 
of support for the convex body Q if Q lies wholly in the half-space 
(fX = C) and the hyperplane has points in common with the boundary 
of Q. 

EXAMPLE 15. In the two-dimensional case, the hyperplanes of support 
reduce to lines of support. In the case of a circle, the lines of support 
are the same as the tangents. In the case of a triangle, the lines of 
support are the three lines along which its sides lie, together 
with all the straight lines passing through its vertices and lying in 
its exterior angles. In three-dimensional space, hyperplanes of sup- 
port become planes of support; for a sphere, the planes of support 
are its tangent planes, and for a cube, its boundary planes and the 
other planes that pass through the intersection of two sides, or 
merely through a vertex and do not cut the interior of the cube. 

Let the equation of the hyperplane of support be 


fX=C. (2.86) 
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THEOREM 11. The number C on the right-hand side of (2.86) is defined 
by the equation 


C = max fX. (2.87) 
XEQ 


The equation of the hyperplane of support therefore has the form 


fX = max fX. (2.88) 
XEQ 
THEOREM 12. The linear function fX attains its maximum C on Q 
at a limit point of Q, i.e. the intersection of (fX = C) and Q contains 
a limit point of Q. 
Coro.Lary. Every hyperplane of support of a body Q passes through 
one of its limit points (in particular, each hyperplane of support of a 
polygon passes through one of its vertices). 


5. Support functions and conjugate spaces 


Let the norm || X|| = 7,(X) be introduced into space £,, and let 
Q be the closed unit sphere: Q = (|| X|| = 1); Q is a convex body in E,,. 
If 
IX = y LX; 
isl 
is a linear form in E, = E,,,, the corresponding hyperplane of support 
of Q is given by the equation 


IX = C(= max IX). (2.89) 
WxXIS1 


Every linear form /X is a vector / with components /,, Jy, ..., J. The 
set of such forms makes up an n-dimensional linear system L,. A norm 
can be introduced into L,, i.e. we can put 


* = ypO= ine Roe (2.90) 


This norm satisfies, along with the norm || X||, conditions (1), (2), 
(3) (see sec. 3) or (1), (2), (3). 
We have: 


[2X] s |TI* A XII. (2.91) 


78 MATHEMATICAL ANALYSIS 


This inequality is a generalization of inequality (2.7) for the Euclidean 
metric. Equation (2.89) can be written as 


IX = |IIII|*. (2.92) 


Conjugate Spaces. The space L, = E,,, thus introduced, of linear 
forms in E,,, is described as conjugate to the initial space E,,,. 
The following notation is used: 


Eny = Eng: (2.93) 
The conjugate to a Euclidean space is also Euclidean. 


THEOREM 13 (Minkovskii). If the spaceE,,, is regarded as the initial 
space, its conjugate becomes E,,, 


Eny = Eng (2.94) 


(the conjugate to the conjugate space is the initial space). 

The reciprocal property whereby spaces E,, and E,, are conjug- 
ates of each other is known as reflexivity. Functions p(X) and »(/) 
are said to be reciprocal; they are connected by the relationships 

max IX = y(I), max [X = 9(X). (2.95) 
o(X)S=1 v1 
Similarly, the convex bodies Q and Q*, defined by the inequalities 
pX = 1, yl S 1, are also said to be reciprocal. (Minkovskii’s theorem 
is no longer in general true for infinite spaces.) 

EXAMPLE 16. Let /, ,(p = 1) be an n-dimensional space with the 

norm 


n 1/p 
XI = (s Ix, r) 
i= 


When p> 1, we have J, , = 1, 4, where (1/p)+(1/q) = 1. 
When p = 2, (the case of a Euclidean norm) we have q = 2 (the 
n-dimensional Euclidean space /, . is self-conjugate: Ca Ino) 
EXAMPLE 17. Let /,, , be an n-dimensional space with the norm 


Ix = ¥ lab 
i=1 


and m,, an n-dimensional space with the norm 


NY] = max(]y%|, yeh ---s IYalds 
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we have: 
In, 1= My mM, ane ln, 1 


Every linear function YX in E,, can be regarded as the scalar 
product of a vector X of E,, and Y of £,,. 


6. Fundamental theorems on support hyperplanes 


THEOREM 14. Let Q be a convex body in n-dimensional space E,,. 
A hyperplane of support of Q can be drawn through every point of 
the boundary of Q. 

The following is a generalization of this theorem: 

THEOREM 15. Let L, (k < n) be a k-dimensional plane drawn through 
an interior point A of the n-dimensional convex body of E,. It cuts from 
Q ak-dimensional convex body Q,. Let L,_, be the (k—1)-dimensional 
plane in L, which is a support plane for Q,. An (n—1)-dimensional 
hyperplane L,,_, can be drawn in E,, which is a support hyperplane for 
Q and contains L,_,. 

Let /,X be a linear form in the k-dimensional manifold FE, C E,, 
(1 = k <n). The linear form /,X in the whole space £, is called an 
extension of the form /, if, for X € E,, 


LX = igh. 
The form /, in L, has the norm 


HAR ln, = max 1/,X. 
|} X|]}S1, XE Ey 


The form /, in E, has the norm 


nll = Write, = max 1X. 
| XS1 


It follows from this that |]/,|] = {l4Ilz,, ie. when a linear form is 
extended, its norm can only increase. 

THEOREM 16. Any linear form 1,,X, defined in a k-dimensional manifold 
L, of E,, 1 = k <n, can be extended to the whole of space E,, without 
changing the norm. 

This theorem can be extended to infinite spaces (the Hahn-Banach 
Theorem). 
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7. The connection between reciprocal convex bodies 


Let Q and Q* be unit spheres in E, and E, . A duality (not one-to- 
one) can be established between the points of their boundaries. 
Equation (2.89) of a plane of support of Q in E, can be written as 


nr 
YX = 2, Yori as 
ic 


In this case (see (2.92)), |] Yo ||* = 1. Formula (2.92) becomes 
YX = || ¥)||* = 1. (2.96) 


We associate with every point X, of E,, for which || Xo|| = 1 (ie. 
points of the boundary of Q), all the planes of support of Q passing 
through it, these planes having equations of the form (2.96). We have: 


YoXo = 1, || Xoll = ll Yoll* = 1. (2.97) 


Formula (2.97) yields an expression for the ¥) €*,, which correspond 
to a given X, €£,; it has symmetry with respect to X, and Yo, 
which points to the reciprocity of this mapping. 
Theorem 14 shows that every X, of the boundary of Q (||Xq||= 1) 
has at least one associated Y, of the boundary of Q* (||Y||* = 1). 
EXAMPLE 18. On the plane mmo, the sphere 


(I|X{] = max (J, |, [>21) = D 


is the square O= B,B,B;B,; on the plane /,,, the sphere (||¥||= 
=|y,|+|¥_| = 1) is the square Q* = A,A,A3A4,. Corresponding to the 

point X, (1, 1) = B, of the boundary of the square Q, we have the 
Yo(1, Ye) for which 


1 = YoXy = WyXytJo%2 = Mityes | Yoll = lni+lmw! = 1, 
i.¢. y:=|},| = 0, yo=ly2| = 0. 


These points thus fill the side A, A, of the square Q*. 

The side B,B, of the square Q lies on the support line X, = 1, ive. 
1.X,+0.X, = 1. The corresponding point is Y,(1, 0) — the vertex A, 
of the square O*. The remaining sides of Q* correspond to the remain- 
ing vertices of Q, the vertices of Q* to the sides of Q and vice versa. 

In three-dimensional space the convex bodies Q and Q* can only be 
convex polyhedra simultaneously, the vertices of Q being associated 
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with the faces of Q*, the ribs of Q with the ribs of Q*, the faces of 
Q with the vertices of Q* and vice versa. Such polyhedra are said 
to be reciprocal. For instance, if Q is a cube, Q* is an octahedron (and 
vice versa); if Q is a dodecahedron, Q* is an icosahedron (and vice 
versa). 

In the n-dimensional case Q and Q* can only be polyhedra simul- 
taneously, the k-dimensional faces of Q (0 =k = n—1) being associat- 
ed with the (n—k-— 1)-dimensional faces of Q*. 


8. The cone. The tangent cone 


A cone K in E, with vertex at Xq € E, is a set of points of £,, differ- 
ent from the whole of £,, and such that, if X belongs to K, the entire 
ray (tX), 0S t < , belongs to K. We shall assume without any 
proviso that the cone K is a convex body. A cone, together with two 





Fic. 3. Fia. 4. 


of its rays forming an acute angle, contains the entire angle. Cones 
on a plane are angles not exceeding z. In three-dimensional space 
examples of cones are provided by dihedral angles not exceeding z, 
ordinary circular cones or regular pyramids, continued indefinitely, 
etc. 

Let X, be a point of the boundary of a convex body @Q in E; let 
us write K(X,) for the least cone with vertex at X, that contains Q; 
this cone consists of all the rays joining X, with points of Q and all 
the limiting rays. We shall call the boundary of this cone the tangent 


82 MATHEMATICAL ANALYSIS 


cone hypersurface to Q at the point Xj; two cases are possible: 

(1) The cone K(X,) coincides with the entire half-space, its 
boundary is the unique hyperplane of support at X, to Q, which 
“touches” Q at the point X5. 

(2) The cone K(X,) is a regular part of the half-space; an infinite set 
of hyperplanes of support of Q passes through the point X,. Such a 
point will be called a point of sharpening. 

EXAMPLE 19. On a plane, thecone K(X,) becomes an angle bounding 
two tangents to Q at the point X, = 0 (the rays OA, OB in Fig. 3); 
if this angle is equal to x, both rays form a unique support line (the 
line A’B’ in Fig. 4), tangential to the boundary of Q at the point O. 
If the angle is less than x, the point O is a point of sharpening, and 
an infinite set of support lines pass through O. 

EXaMPLE 20. Let Q be a convex polyhedron in E£;. If the point X) 
lies inside a face, K(X>) is the half-space bounded by the plane of the 
face, which is the unique support plane of Q at X. If Xq lies inside 
a rib AB, K(X,) is a dihedral angle less than z, formed by the planes 
of the faces that intersect in AB; there is an infinite set of support 
planes to Q at Xo, all of which pass through the rib AB. If X, is a vertex 
of Q, K(X,)isa polyhedral angle with vertex at Xp, bounded by the 
planes of the faces that meet in X); points of the ribs, and all the more 
the vertices of Q, are points of sharpening. 


9. Helly’s theorem 


An interesting theorem on the intersection of convex bodies must 
be mentioned. 

THEOREM 17. Let {Q} be an arbitrary set of convex bodies given in 
E,,, at least one of which is bounded. If any n+-1 of them have a common 
point, there is a point common to all the bodies of {Q}. 

For instance, if an arbitrary set of segments, such that any pair 
has acommon point, is given on a straight line, there is a point common 
to all the segments. 
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10. Linear operations on sets 


DEFINITION. Let A and B be any sets of E,,. The vector sum A+B of 
these sets is defined as the set (X) of points of E,, expressible in the form 
X = X,+X2, where X,€ A, Xy€ B. 

EXAMPLE 21. If A is an arbitrary set, a a point (vector), then A+a is 
the set obtained by parallel displacement of the set A along the vec- 
tor a. 

EXAMPLE 22. If A is the x-axis, B the y-axis, A+ Bis the entire plane. 

EXAMPLe 23. If A in E,, is an n-dimensional closed sphere of radius 
o with centre at 6, A+Bisa “layer” of thickness 9 round B, i.e. the 
set of points of £, at a distance less than or equal to @ from B. 

THEOREM 18. The vector sum of convex sets (bodies) is a convex 
set (body). 

DEFINITION. Jf A is a number, A a set in E,, AA is the set of all points 
of the form 2X, where X € A. 

A similitude transformation of the set A with transformation coeffi- 
cient A > 0 is a transformation of the set A into the set AA. A symmet- 
ric mapping of A with respect to the centre # is a transformation of 
A into —A. 

When A = 0 the set AA consists of the single point 6. 

If A is a convex set (body), 4A is a convex set (body). 


n 
If A; i = 1, 2,..., a) are convex sets (bodies), }' 4,4; is a convex 


i= 
set (body) for any system of non-negative aumbers yy Ags oo ey Ane 
Let T, (I = C,) and T, (J = C,) be two parallel hyperplanes of support 
of the convex bodies Q, and Q,, while (/, S C,), (J, S C,) are the corres- 
ponding half-spaces containing Q, and Q, respectively; t,, fp are arbit- 
rary positive numbers. Now, ¢,7,+7, is a hyperplane of support 
parallel to them (/ = 1,C,+t)C,) of the body Q = 1,0,4+ t2Q, lying 
in the half-space (/ S t,C,+f&C,). 

THEOREM 19 (Brunno-Minkovskii). Let Ay and A, be convex bodies 
in E,, and A, = td4g+(1—0)A;, 0S t S1, a “linear system” of convex 
bodies; the n-dimensional volumes J,, of the bodies Ao, A, and all the 
A, are connected by the Brunno-—Minkovskii inequality 


VIA) = (1-2) VIn(Ao) +t°/F,(Ay- (2.98) 
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The case of equality occurs if and only if Ag and A, are homothetic convex 
bodies, i.e. one is obtained from the other by a similitude transformation 
and parallel displacement (A, = tAy+b, t = 0, b is a vector). 
Inequality (2.98) was proved by Brunno (in 1887); the case of 
equality was proved by G. Minkovskii (in 1891). 
Inequality (2.98) implies that */ J,({A, is a concave function for any 
tin [0, 1). 


The theorem still holds for non-convex bodies, and in general for any sets, 
if J,(A) is understood as the exterior n-dimensional measure of the set A or the 
measure when it is measurable (see ref. 7). 


The Brunno-Minkovskii theorem is employed in proving the iso- 
perimetric and numerous other geometric properties of convex bodies, 


CHAPTER II 


SERIES 


Introduction 


Infinite sequences and their limits have been discussed in Chap- 
ter I. Infinite series, or simply series, are closely connected with 
sequences, e.g. 


Q+a+...+4,+...= Ya, (3.1) 


is “the sum of an infinite number of terms”. 

Series are commonly employed in the most widely spread branches 
of mathematical analysis and in the solution of applied problems, 
since they represent one of the most universal and effective means 
both of investigation and computation. 


Examples of series (infinite geometrical progressions) were known to the 
mathematicians of antiquity. In the process of developing the analysis of infinitesi- 
mals, series made their appearance, with the aid of which the values of various 
functions could be computed: Mercator’s series for the logarithm, Newton’s 
series for sin x, cos x, arc sin x, arc cos x, (1+x)®, etc. Series were widely used by 
Euler for representing functions in various works; in addition to power series, 
trigonometric series were employed by Euler. He also made use of divergent 
series, and seems to have been the first to be concerned with improving the converg- 
ence of series. The vast amount of factual material on series that had accumulated 
by the beginning of the nineteenth century posed to scientists the problem of 
finding a strict basis for the theory of series. The investigations of Abel, Gauss, 
Cauchy and others in this direction played an important part in laying the foundat- 
ions of mathematical analysis as a whole. 


The present chapter is devoted to the basic theory and practice 
of evaluating series. Numerical series are considered in § 1, functional 
in § 2, and the various methods of computing them in § 3. (See 
Chapter IV for vector series.) 
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1. Basic concepts 


DEFINITION: A series is defined as in (3.1), composed of the 
terms of an infinite sequence {a,} (n= 1, 2, 3, ...). For every 
series there is a corresponding sequence {s,} (m = 1, 2, 3, ...) of 
partial sums, where 


n 
Si =, Sp = Atay, ..., i= DY Opp Biss (3.2) 
=1 


EXAMPLE 1. Given the series 


we have 
4 6S 1 
$s, = 1, ee oees an 3 l—a peeee 


The following two cases are possible when considering the sequence 


of partial sums. 
Case 1. The sequence {s,} has a definite finite limit 


S= lim s,. 
Nn—> oo 


This limit is called the sum of series (3.1) and is written as 


cas a (3.3) 


In Example 1, 


Case 2. The sequence {s,,} has no finite limit. 


EXAMPLE 2. 
142434 ...+n+ = }n; 
ne} 
s=1, & = 3, ; , = Oe, 4 


As n— oo, the partial sum s, + o. 
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EXAMPLE 3. 
Piste as eet 
n=1 
QO when n is even 
Ss =1, 9 = 0, s,=1,....,5,= f 
: - 1 when n is odd. 
EXAMPLE 4. 
1-2+4-—8+...= YS ea 
n=l 
awit ne 
5, = 1, S,= —-], $3 = 3, Sy = 5, «ee, g =A T 


In Case 1 the series is said to be convergent, whereas it is divergent 
in Case 2 (Examples 2, 3, 4). 

Example 2 illustrates an important particular case of a divergent 
series, when 5, +o (or 5, +— oo); Example 3 illustrates the case 
when s,, oscillates while remaining bounded, and Example 4 the case 
when s,, oscillates but is unbounded. 

We shall only discuss convergent series in this section. In the case 
of a convergent series (3.1), the sum S can be written as 


S= s,+R,; (3.4) 
where 
Rn = GngitGngat -.. = > a, (3.5) 
khen+1 
is called the remainder or remainder term of the series. 

Evaluation (or summation) of a series implies finding its sum S. 

We must therefore verify the convergence of a series before finding 
its sum. 

Strict summation (some methods of which will be given below) 
is only possible for a narrow class of series. For the majority, the 
sum is found approximately. In approximate summations, the sum 
S is replaced by the partial sum s,. 

It follows from the definition of the sum of a convergent series 


that 
lin R, = lim (S—s,) = 0. (3.6) 
N=—> co 


N—> oo 
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This indicates that, given a sufficiently large n, the absolute value 
of the remainder term R,, can be made as small as desired. 

To ensure the required accuracy when replacing S by s,,, it becomes 
necessary to estimate the difference 


S —S, = Ry, 
i.e. the remainder term. 

In addition, practical convenience in computations requires that 
the number n of terms of the partial sum s,, required for achieving 
the necessary accuracy, be not too large. Reasonably accurate summa- 
tion of certain series would require taking thousands, or even tens 
of thousands, of terms. Such series are said to be slowly convergent. 

EXAMPLE 5. To compute the sum of the series 

1 1 1 = 1 
ioe a gts = Poi 1)" 
to an accuracy of 0-001, the summation of a thousand terms is needed. 

The question thus arises of improving the convergence of a series, 
i.e. transforming it in such a way that summation of the transformed 
series with the same accuracy requires a smaller number of terms 
in the partial sum s,. The fundamental questions for the summation 
of series are therefore: convergence, estimation of the remainder 
term, improvement of the convergence. 


2. Some convergence tests for series 


Cauchy’s test for the convergence of a sequence (3.2) takes the 
following form as applied to series. 

Caucny’s Test. The necessary and sufficient condition for converg- 
ence of the series (3.1) is that, given any €>0, there exists ann, such 
that . 

l@ngitQngat +--+ +4naml < & 


for alln>n, and any integer m. 
An important corollary follows from this test with m = 1. 
If series (3.1) is convergent, its general term a, tends to zero asn 
increases: 
a,>0 as n+ o, 
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This condition is necessary but not sufficient for convergence. 
EXAMPLE 6. The harmonic series 
1 1 =e 
lee at os = — 
is divergent, although a, = 1/n + 0 as n + o. 

Cauchy’s test is the most general necessary and sufficient criterion 
for the convergence or divergence of a series. 

Direct application of it is difficult, however. The theory of series 
includes a whole range of sufficient tests for convergence and diverg-. 
ence of varying degrees of generality, and widely employed. Histor- 
ically, the first of these is 

D’ALEMBERT’S TEST. Jf the limit 


n—> oo | ay 


exists for series (3.1), the series is convergent when q<1 and divergent 
q> 1. (The test is inconclusive when q = 1). 

A more general test is 

THE CAUCHY-HADAMARD TEST. We write 


q = lim Yla,}. 
Rh-—> co 


Series (3.1) is now convergent when q <1 and divergent when q>1. 
(The test is inconclusive when q = 1.) 
THE PRINCIPLE OF MAJORANT SERIES. The series 


by +bg+ oe ES by bn (3.7) 


with non-negative terms 5, is said to be majorant for series (3.1) if, 
given any n, 
|@n| = by 

as from some n= N. 

The convergence of series (3.7) implies the convergence of series 
(3.1). 

Numerous convergence tests are based on the principle of majorant 
series, including in particular the d’Alembert and Cauchy-Hadamard 
tests. 
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§ 1. Numerical series 


1. Alternating series and series of constant sign 


If all the terms of a series are of the same sign, the series is said 
to be of constant sign. Such series include those, all the terms of 
which are positive (positive series), and those, all the terms of which 
are negative (negative series). 

If all the terms of a series are not of the same sign, the series is 
described as alternating. When there is a finite number of terms of 
the same sign, they can be neglected when investigating the converg- 
ence and attention paid only to the remaining series of constant 
sign. The theory of series with an infinite number of positive and 
negative terms has certain differences in principle from the theory 
of series of constant sign. 

The following is a particular case of the principle of majorant 
series. 

THEOREM 1. The series 


{+t ...¢a,+...= Pa, (3.8) 
with terms of arbitrary sign is convergent if the series 
[a,|+]aglt+t...+]a,|+...= Y Ian! (3.8*) 
n= 


formed from the absolute values of the terms of series (3.8), is convergent. 

In this case series (3.8) is described as absolutely convergent. All 
series of constant sign are absolutely convergent. 

Cases are possible when series (3.8) is convergent, and series (3.8*) 
divergent. Series (3.8) is then described as non-absolutely, or condi- 
tionally convergent. 

EXAMPLE 7. The series 


1 1 _ & (-)™) 
ay a ce eee nn 
is convergent and its sum is S = In 2. 
On the other hand, the series of the absolute values of the terms 


is the divergent harmonic series. 
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2. Properties of convergent series. The associative property 


If the terms of the convergent series 


Atagt...td,t...= Yay 


n=l 
are grouped in any manner, without changing their order: 


At oe +a, Anyti1t eee + ang» anger t eae + an, os 
os Qn 41+ Pore +a, oeey 


where {n,} is a partial increasing sequence of numbers of the natural 
series, the series of the sums of the terms of these groups 


(Q,+ ... HOn)+ (nti t +++ $n) +.-- 


is always convergent and has the same sum as the initial series. This 
property can be utilized for improving the convergence of series. 
The rearrangement property of absolutely convergent series. If the 


series }\ a, is absolutely convergent, the series obtained from it 
n=1 

by any rearrangement (commutation) of the terms is also convergent 

and has the same sum as the initial series. : 

Non-absolutely convergent series do not have the commutative 
property. We have, furthermore, 

THEOREM 2 (Riemann). The terms of a non-absolutely convergent 
series can-be rearranged in such a way that the transformed series 
has a sum equal to any previously assigned number, or becomes di- 
vergent, 


3. General tests for the convergence of series of positive terms 


If we want to determine the convergence of the series with positive 
terms 


yay, (3.9) 


k=l 


we choose at discretion another series with positive terms 


yen (3.10) 


R=} 
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such that its convergence and sum are already known to us. 
We introduce the notation: 


Rm = _¥. a3 B.11) 
ham 


R,,, is the remainder term of the series, which is equal to a finite posi- 
tive number if series (3.9) is convergent, and to o, if series (3.9) 
is divergent; 


b 
Ax) = ae (3.12) 


where / is a parameter taking integral values such that m+/z2 0, 
m is a fixed positive integer; 


lim 4, = AO, (3.13) 


h~ co 
lim 4,() = A(D. (3.14) 
ho co 
Let 
lim J by = By (3.15) 


nupoco kh=m 
fim S' by = Bri (3.16) 
n>o ham 


in the case when the lower and upper limits coincide, i.e. when the 
limit exists, we introduce the notation: 


lim 4,() = A(D, (3.17) 
hk=>oo 

n 
lim ) d,=By (3.18) 
neo ham 


We have the following sufficient tests for convergence of series 
(3.9). 

Test I. If A(])> 0 and B,, < + ©, series (3.9) is convergent, whereas 
if —o <A() = 0 and B,, = — &, the series is divergent. 

Test II. If AD <0 and B,> — oo, the series is convergent, whereas 
7¥Os A) < + «and Bp, = + oo, the series is divergent. 
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Test Ill. If A() >0 and B,, =< + or A(I)<0 and B,> — «, the 
Series is convergent; if0 SA(l) < + and B,,= + ~or—o< ANS0 
and B,, = — , the series is divergent. 

By a suitable choice of auxiliary series (3.10), we can obtain 
as particular cases from Tests I, II and III either new or already 
familiar sufficient tests for the convergence of tests with positive terms 
(see sec. 5). These tests include, in particular, the familiar necessary 
condition for convergence which says that, if series (3.9) is convergent, 

lim a, = 0. 
N—> 00 


4. Remainder term estimates corresponding to the various 
convergence tests 


When one of the convergence Tests I, II, III is satisfied for series 
(3.9), a corresponding estimate of the remainder term can be given. 
(1) For Test I: 


Bm ‘m 

inf A) = m+! = ap A’ He) 
k= m k=m 
where m is such that all the A,(/)>0; / is an integral parameter, 
satisfying the condition m+/ 2 0. 

(2) For Test II: 


m m 
“ink 4,0) = ®m+t = sap Ax’ _ 
k=m kZ=m 


where m is such that all the 4,(/) < 0 and m+/ 20. 

(3) For Test III, if A()>0, inequalities (3.19) hold, while (3.20) 
hold if A(D < 0. 

For Test III, it becomes convenient to utilize the following par- 
ticular cases of (3.19) and (3.20): 

(a) When A(/)> 0 and the sequence {A,(/)} is monotonically in- 
creasing for k = m, we have 


Bm Brn 
AQ = Ron SO a 
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(b) When A(/)<0 and the sequence {A,(/)} is monotonically 
decreasing for k = m, we have 


Bn BA 
A,Aly = Ry += AO 

(c) When A(/)<0 and the sequence {A,(J} is monotonically 
increasing for k = m, (3.21) holds. 

(d) When A(/J) > 0 and sequence {A,(J)} is monotonically decreasing 
for k = m, (3.22) holds. 

EXAMPLE 8, Let us estimate the remainder term of the series 


= 1 


(3.22) 


Qe 
On putting, say, b, = 2,_,—2,, Where z, = —1/2n?, we have, 
provided that m> 1 and /20: 
_ Qm+l1)(m+D§ 
AnD = Frnt 1’ 
tus Aes Baie t= Bate 25 fd 
A() = Pacers =1, Br= im Gn+1— 2m) = 2° 


It is easily verified that the sequence {A,,(0)} (m= 1, 2, 3, ...) 
is monotonically increasing, while the sequence {A,,(1)} (m = 1, 2, 
3, ....) is monotonically decreasing. 

Consequently, when / = 0 and m = 1, we have by (3.21): 


1 (m+ 1) 
ame ~ Bm ~ Ome De’ 
while with / = 1, by (3.22), 
(2m +1) (m+ 1) m+l 2m" 
We obtain from the last two inequalities, in choosing the greatest 
lower and least upper values, 
1 (m+1)? 
Gm—Dm ~*~ m+ Dnt’ 
This example shows that, given the same choice of sequence {b,} and 


different values of the index /, estimates can be obtained that do not 
overlap each other. 
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5. Special tests for the convergence of series of positive terms. 
Estimates of the remainder term 


Numerous familiar classical tests for the convergence of series 
with positive terms follow from the general convergence Tests I, I 
and III (sec.3). We shall give here certain of these and the corres- 
ponding remainder term estimates (see ref. 9). 

1°. THE GENERALIZED D’ALEMBERT TEST. The following two tests 
can be regarded as a generalization of the d’Alembert test mentioned 
above. 

Test A. If, for a fixed l, 


A) = im 217% — 0, (3.23) 


n>eco Ant] 
oo 


the series Y a,, is convergent, whereas the series is divergent if 
nel 

An41—@ 

AQ) a lim “n+il“n 


noe Atl 


> 0, (3.24) 
Test B. If, for a fixed I, 


A() = lim “et17% 


nN—> co ai 


is negative, the series is convergent; whereas if the limit is positive, 
the series is divergent. 

In particular, when / = 0 Tests A and B yield d’Alembert’s test 
(Introduction, sec. 2). 


If the convergence of the series }' a, is established with the 


nel 
aid of Test A or B, we have on the basis of (3.20): 


= R41 = ——_"— (3.25) 


If the sequence {A,(/) = (4,4,;—4,)/a,,,} is monotonically in- 
creasing for k = m, we have 





Sh (3.26) 
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If the sequence {A,(/)} is monotonically decreasing for k = m, 
we have 


—-@4. — 
an 5 Rang S am ; (3.27) 
lim R+1 k m+1 m 
Ro = R41 antl 
EXAMPLE 9 
| 
Dat (3.28) 


It is easily verified that, if /+1 <0, the sequence {A,() = (a,,,— 
—a;,)/a,,,} for series (3.28) is negative and monotonically decreasing 
as from a certain k = N(J). If 1+ 1 > 0, the sequence {A,(/)} is negative 
and monotonically increasing. 

We therefore have, on the basis of (3.27) with /+ 1 = 0, as from a 
certain m 2 N(I) (say as from m= 1 when / = —1): 


1 Reng te (m+ 1? 
Dae = Sms = arm + TP met am +2) 
When | + 1> 0 we have to reverse the inequality signs in the above. 
For instance, on putting m+/ = 6, and accordingly assigning the 
following values to m and /: 






































it may be seen that the best upper estimate is obtained with / =—1, 
and the best lower estimate with/ = 0, so that in this case 0000686 = 
= R, = 0-000703. 

2°. THE GENERALIZED CAUCHY Test. On putting 5, = 0” and 
applying Tests, I, II (sec. 3), we get the following convergence test, 
which may be regarded as a generalization of the Cauchy-Hadamard 
test. 

Test C. If, for a fixed | and e <1, 


nm 
lim -& 


> 0, 
n— co anit 
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oo 
the series ). a, is convergent; whereas the series is divergent if, 
new} 
for a given | and o>1, 
ne 





0 s lim < oo, 
n-poo “n+l 
When / = (0, this test yields the familiar Cauchy—Hadamard test 
(Introduction, sec. 2). 
If the convergence of the series can be established with the aid 


of Test C, we have by (3.19), for any m+/> 0, 


gm om 

= = Rast = ————__S— (3.29) 
(1—@) sup — (1-9) inf —— 

h=m F41 h=m Gryt 


Here, g<1 is an arbitrary number, for which lim (9"/a,,,)> 0. 
n—> co 


If the sequence {A,(J) = o*/a,,,} is monotonically increasing for 
k = m, we have 





o™ a, 
Sen Ney ae (3.30) 
(1-9) lim 2 2 

R—> cc Any} 


Whereas, if the sequence {A,(/)} is monotonically decreasing for 
k = m, we have 








m 
cae S Rn 3 iene aerate j (3.31) 
@ (1-0) lim 
h r+ 
EXAMPLE 10. 

oo x” 
— 0Osx< 1). 3.32 
Lag ‘Oa7=0 3.32) 


It is easily shown that estimate (3.31) can be applied to series 
(3.32) on condition that m+/ 2 3. 
On taking 0 = x, we have 
xml - xmt 
—_—_—_—_—_—— S&S = . 
d—-x™Ymtl ™ Ty 
3°. RAaBE’s Test. A particular case of the general Test III 
(sec. 3) is 
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Test D. The series ¥\ a, is convergent if, for any integral |= 0, 


nel 
A() = lim FOn41—(2~ Way 0, (3.33) 
n-> eo an+t 


and is divergent if 
A(D) > 0. 
When / = 0, we get 


oo 
Raabe’s Test. The series )\ a, is convergent if 
n=l 


{fea 
lim n(1—Sas1) >1, 
n—> co ay 
n(1—“es2) <1. 
ay 


= 1 
py n(n+ 1) (n+ 2) ° 
The convergence of this series is readily established by applying 
Test D. We can also make use here of the estimates for the remainder 
term of sec. 4, corresponding to cases (3), (c) and (3), (d). 
On applying estimate (3), (c) (sec. 4) with m = 9, and 1 = 2, we 
get 


and is divergent if 


for all n= ny say. 
EXAMPLE 11. 


(3.34) 


(m— 1) (m+ 3) a m-1 
(m—3)(m+l(m+1+l)(m+142) = Rm+t & (m+ 1) (m+ 2) ° 
(3.35) 


On applying estimate (3), (d) (sec. 4) with m+/> 0, 1s 1 and 
m> 41/(2I—3), we have 


(m—1) (m+ 3) Lp m—1 
Qm—3)(m+)(m+1+1)(m+1+2) = "+! = Baim + lymta) 


(3.36) 
On comparing inequalities (3.35) and (3.36), say with m+/ = 12, 
it is easily seen that 
0-00315 s Ry» = 0-00337, 
he true value here being Ry. = 0-00320. 
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4°. Gauss’s Test. If lim a,,,/a, = 1, d’Alembert’s test gives 
nN—-> co 


no answer as regards the convergence of the series, as mentioned 
above. If the ratio a,,,/a, has the form 


Ong _ +pn“1+9(n) 
a, m+qn—14 y(n)’ 


where g(n) and y(n) have lower orders than n*~!, the convergence 
or divergence of the series may be established with the aid of the 
following test. 


Gauss’s Test. The series ) a, is convergent when q—p> 1, 
nol 
and divergent when q—p = 1. 


EXAMPLE 12. When x =1, the hypergeometric series (ref. 7): 


oP et BB+), xe+1) @+DBGB+DG+2 


Ly? 1avyth * 12379+D0+2) 


+... (3.37) 


is convergent provided that 
y>oatB. 


Notice that, from a certain m onwards, series (3.37) is of constant 
sign for any real «, B, y (it is assumed that none of the numbers a, 
B, y is negative). 

We have in the present case, say with / = 0, 


Ay(0) = P=OO=P) yap) 
and 
A(0) = -(y—«—8) < 0. 
On observing that, for alln > —y+, the sequence {4,(0)} will be mono 


tonically increasing or monotonically decreasing, and making use 
of (3.26) and (3.27), we get 


(m+y)man, 
(m+y) (y—«—B)—(y—) (y—B) 
(m> —y), 


= = May, 
Ryn ——:; 
= = y-a—-B 
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where 
_ +1)... (z+ m—Nb(b+1)...(b+m—1) 
miypytl)...(v+m—1) . 
5°. Caucuy’s INTEGRAL TesT. Let the general term of the series 


> a, be monotonically decreasing with increasing n. Obviously, 
ne 
it is now possible to choose an infinite set of positive functions a(x), 


monotonically decreasing and continuous for x > 0, and such that 


a(n) = a). 
Let a(x) be one of these functions. The series }’ a, is now converg- 
n=l 
ent or divergent, according as the improper integral 
i ” a(x) dx, (3.38) 
a 


where « = 1, is convergent or divergent. 
This test follows as a particular case from general Tests I and II 
(sec. 3), if we put say 


+1 
b, = f. a(x)dx and J=0. 
n 


EXAMPLE 13. We are given the series 


. es (o > 0). (3.39) 


ned 


We choose as a(x) the function 1/(x 1n'*’ x) and put a = 2, so that 





ee 1 1 {= 1 
i xin'+¢ x OAS oln?x |, oln?2’ 
the series is therefore convergent. 
EXAMPLE 14. We are given the series 
= 1 
2 Siaaininn: G4) 


We choose a(x) = 1/(xIn x ln In x) and put a = 3: 


3 x nxininx ; 


so that the series is divergent. 


|) sesoms* = Inininx| = co, 
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EXAMPLE 15. Given the series 
es 1 


n=y ‘ 


(3.41) 


we choose a(x) = 1/x” and put « = 1. On recalling that 


1-— 


dx jee for o #1, 
—=) l-o 


Inx for o=1, 
we get: 


1 


ce dx | tt. for o> 1, 
C— 
oo for o sl. 


The series is thus convergent for o> | and divergent for o Ss 1. 
Notice the following points: 

(1) In view of the fact that the choice of the function a(x) is to a 
large extent arbitrary, an infinite set of estimates can in general 
be quoted, corresponding to the test. 

(2) When the sequence {a,} is monotonic, estimates correspond- 
ing to Cauchy’s integral test can be used, independently of the 


particular test used to prove the convergence of the series yaa 
n=l 
EXAMPLE 16. 
n 
my re (a > 1). 
Let a(x) = x/a*, say. The function a(x) is monotonically decreasing 
for x > I/log a. Therefore, on evaluating 


qk (h+1 a~l1  a—\ina-1 
Ay=— xa7* dx = ——_ +. ————__—_ 
ay 2 a Sree alna ka \n? a 


and making use of estimate (3.26), we have 
m(m In a+ 1) Spee 


Ina a™1(a—1) Ina’ 


m1 7 = 
a™-l(q D( mina wat 


(m = 1). 
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6°. N. V. BUGAEV’s THEOREM; V. P. ErMAKOv’s TEST. Let a(x) 
be the function introduced in the statement of Cauchy’s integral test, 
and 6(x) some positive differentiable function, increasing as x increases 
and such that lim 1/d(x) = 0. The following theorem can now be 


x-> oo 
obtained on the basis of Cauchy’s integral test. 


THEOREM 3 (N. V. Bugaev). Jf the punclion 6'(x) a{e)] is mono- 
tonic for sufficiently large x, the Series % a, and y 6'(n)a [4(n)] 


n=l n=l 
are simultaneously convergent or divergent. 


Thus any convergent test applied to the series y 6'(n)a [6] 
n=) 
will at the same time yield a convergence test for the series y a,. 
n=l 
In particular, we have the following corollary of N. V. Bugaev’s 
Theorem. 
V. P. ERMAKOov’s Test. Jf 
. e™a(e™) 
lim 


<i, 
m-—>eo (mM) 
the series )' a,, is convergent; whereas if 
nel 
. e™a(e™ 
lim (e”) 
m—+>eoo a(m) 





> 1, 
the series is divergent. 
N+1 
On putting say b, = | 6'(x)a [6(x)] dx and using the general 


n 
tests of sec. 4, an infinite set of estimates can be obtained (for the 


remainder term of the series }' a,), corresponding to different 
nel 
methods of choosing the functions 4(x). 
7°. LOBACHEVSKI!’s TEST. If the terms of the series 


¥ a(n) 


nel 


are monotonically decreasing, then the series is convergent or divergent 
at the same time as the series 


a Paes 


m=1 
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where p,, is given by 
APpm) = 2-7, apmtl)s2™. 
We can also define p,, from the equation 
a(Pm) = 2-™, 


if the function a(x) is monotonic and defined for any value of x. 
EXAMPLE 17. 
= 1 
ney 
The equation 
1/Pin = 2-™ 


1 
, >~m 5 
gives us p,, = 2? ; we form the series 


Dy Pm2-™ = » ae 
m=l 


m=l 


welg 


This is a convergent geometrical progression, so that the series 


> =; 
na 
s also convergent. 


6. The convergence of alternating series 


103 


Given the alternating series (3.8), we form series (3.8*) from the 


absolute values of its terms. 


To-establish the absolute convergence of series (3.8), we can apply 
to the positive series (3.8*) all the tests described above for series 
of constant sign. As already mentioned, however, tests for the con- 


vergence of series (3.8*) may not be valid for series (3.8). 


Alternating numerical series. Alternating series are those, the terms 
of which are alternately positive and negative. The following holds 


for such series: 


TueEoreM 4 (Leibniz). If the terms of an alternating series )° a, 


nel 


are monotonically decreasing in absolute value, 


|Qny1| S | ay | (n = 1, 2, D3 553) 
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and the n-th term tends to zero, 


lim a, = 0, 
noo 
the series is convergent. 


Estimation of the remainder term of an alternating series is simple 
and effective. 

The remainder term of an alternating series that satisfies the con- 
ditions of Leibniz’s theorem, 


Rn = @ngitangot +++ 
has the sign of its first term a,,, and is less than it in absolute value: 
| Ral = GngitGngot +++ 


The criteria for convergence of Abel and Dirichlet are more general 
than Leibniz’s test. : 
Suppose we have the series 


2 Onby = Ayby + agbg+ «6. tagbat ...; (3.42) 


where {a,} and {b,} are sequences of real numbers. 
ABEL’s TEST. Series (3.42) is convergent if the series 


¥Y bp = by tht... tbat... (3.43) 
n= 
is convergent, while the numbers a,, form a monotonic and bounded 


sequence: 
la,|<K  (n=1,2,3,...). 





EXAMPLE 18. 
22 1\ 4 i 1 
E(-x)e3 ®=I—-a<l bn = gate 


DIRICHLET’S TEST. Series (3.42) is convergent if the partial sums 
of series (3.43) are bounded in aggregate: 


|s,xl SM (n = 1, 2, 3, ...), (3.44) 


while the numbers a, form a monotonic sequence tending to zero: 
lim a, = 0. 
n=->oo 


SERIES 105 


Assumption (3.44) is more general than the assumption of the 
convergence of series (3.43), so that Abel’s test is a consequence of 
Dirichlet’s test. 

7. Infinite products and their convergence 


Suppose we have a sequence of numbers (or functions) 


Pt» Po» Par +++. Pav eves (3.45) 
The symbol 
I Pa = PrP2P3 - . (3.46) 
n=1 


s known as an infinite product. 
The product of a finite number of consecutive terms 


Py = py, Py = PyP2, Ps = PyPoPy, --+> Pr = PiPo-++Pn-iPn (3-47) 


is called a partial product. The sequence of partial products will be 
denoted by {P,}. 
EXAMPLE 19. 


=  n(n+3) 14 2.5 3.6 


ti G@+DG+2) ~ 23 34 45°" 
The convergence of infinite products. 
Four fundamental cases may be distinguished. 
(1) The sequence of partial products {P,,} has a finite limit different 
from 0: 
lim P, = P. (3.48) 


n—> co 
This limit is called the value of the product and is written as 
P=f]P,. (3.49) 
nel 
The product itself is said to be convergent in this case. In Example 19, 
otto i 
CPG ge 
(2) The sequence {P,,} tends either to + ~, or to — ~, 
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EXAMPLE 20. 


J] m#=1.2.3...2...;5 Pr, sant; lim nl! = &, 


n=l n—> co 
(3) The sequence {P,} has the limit 0. 
EXAMPLE 21. 
es for any n if pas ree aay 
Pr= 5 y 2 > no on? wan . 


(4) The sequence {P,} has no limit (e.g. oscillates). 
EXAMPLE 22. 


— an Mn+3) 
CD Gaeta 


i L4f_2.5\3.6/ _ 4.7 ees eee 
9.3) “FAS. 5.6) 8 3 ee Se 


In the last three cases the sequence is said to be divergent. Case 
(3) ( lim P, = 9) implies a different classification to that accepted 


N-—> co 
for infinite series. However, this is convenient for the statement of 


many theorems on infinite products. 
An infinite product can be written in the form 


TI Pn = Pm: (3.50) 


n=l 
where 


Pm = PiPo+++Pm 
is the partial product of the first m terms, and 


Te = Desi Pareios = TL. Pa (3.51) 


n=m+l 


is called the remainder product, this being analogous to the remainder 
term: of a series. 

THEOREM 5. If product (3.46) is convergent, the remainder product 
(3.51) is also convergent for any m (if all the p,, + 0); the convergence 
of the remainder product implies the convergence of the original product. 
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Thus discarding a finite number of initial factors or combining 
at the start a finite number of factors has no effect on the convergence 
of an infinite product. 

If an infinite product is convergent, then 

lim z,, = 1. (3.52) 
m—> co 


This follows from (3.50); 


and from the fact that P # 0. 
If an infinite product is convergent, then 
lim p, = 1. (3.53) 


n>oco 


This follows from the chain of equations: 


fey lim P, 


n—>oco lim P,_; - P a 


In the case of a convergent product, p, > 0 as from a certain n. 
This follows from (3.53). In view of Theorem 5, we can assume with- 
out loss of generality that all the p, > 0. 

There is a connection between the convergence of infinite products 
and that of series. 

A necessary and sufficient condition for convergence of the infinite 
product (3.46) is that the series 


> In pp (3.54) 


n=l 
be convergent. 
If S is the sum of series (3.54), we have 
P=eé, (3.55) 
On writing s, for the partial sum of series (3.54), we have 
S, = InP,, Py, = es, (3.56) 
It follows from the continuity of the logarithmic and exponential 
functions that, when P,, tends to a finite positive limit P, the partial 


sum s, tends to In P, and conversely, if the finite limit S exists, the 
limit for P is equal to e%, 
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The nth term of an infinite product may be conveniently written 
as 
Pr = 1+a, 


and product (3.46) written as 


eo 


I] G+4,), (3.57) 


n=) 


while series (3.54) is written as 
¥ In(1-+a,). (3.58) 
nel 


THEOREM 6. If, for sufficiently large n, all the a,,> 0 (or a, < 0), 
the necessary and sufficient condition for convergence of product 
(3.57) is that the series 


yay. (3.59) 


be convergent. 
A necessary condition for convergence of (3.57) and (3.58) is that 


lim a, = 0, whence m has) =1, 
N—> co N~—> co a, 


In the general case a, = 0, the infinite product (3.57) is convergent 
if the series 


a2, (3.60) 


n=] 


is convergent along with series (3.59). 
The product of Example 19 can be written as 


re (n+3) 2 
Uae pasd (n+ 1) (+2) = fi(! ares) 
Here 
_ ~—2 
on = G+) (+2) 
and 


lim a, = 0. 
N—> oo 
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The following will make it clear why, in the case 
P=0, 


the infinite product is classified as divergent. 

The necessary and sufficient condition for the infinite product to have 
a zero value is that series (3.54) or (3.58) have the sum — ~. 

This is the case for example when a, < 0 and series (3.59) is diver- 
gent, or, when series (3.59) is convergent, but series (3.60) is diver- 
gent. 

Product (3.46) is said to be absolutely convergent when series 
(3.54) of the logarithms of its factors is absolutely convergent. 

An absolutely convergent product has the commutative property. 
The necessary and sufficient condition for absolute convergence of 
product (3.57) is that series (3.59) be absolutely convergent. 

We have, for Example 19: 


2 1 1 
lanl = GaHG@FD ~ -GEDGFD 2 


But }° 1/n? is a convergent series (see example 15), so that the 
n=1 
product is absolutely convergent. 

It may be remarked that the theory of functional products bears 
the same relationship to the theory of numerical products as the 
theory of functional series to that of numerical series. Let us give 
an example of a functional product. 

EXAMPLE 23. The product 


*H('-za) 


represents sin x for any x. 


8. Double series. Fundamental concepts and definitions 


In addition to ordinary (simple) infinite series, multiple series are 
employed in analysis and applied mathematics, e.g. double, triple, 
etc., series. We shall confine ourselves here to a brief outline of the 
theory of double series. 
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DEFINITION. A double series is defined by the symbol 


t) 


yy ae ( ath): (3.61) 


h=0 l=0 


and is made up of the terms of the double sequence {a,,} (k = 0, 1, 
2,3, ...; 1 = 0, 1, 2, 3, ...); corresponding to it, we have a double 
sequence {Sj,} of partial sums 


kem—-1,l=n-1 
Smn = > Op (3.62) 
k, l=0 
If a finite limit exists on simultaneous and independent increase 
of the indices m and n, 


S= lim Smn= DY app (3.63) 
N—> oo k, 10 
m— co 


the limit is called the sum of the double series (3.61), and the series is 
said to be convergent in this case; otherwise it is divergent. 

If the terms a,, are summed consecutively, first over one index, 
then over the other, the double sum will be described as an iterated 
series. Obviously, the following two cases are possible here: 


‘y ( > on) (3.64) 
leo \ k=O 
y & on) . (3.65) 
k=o \1=0 
Iterated series (3.64) is said to be convergent if the series 
A, = oy Qn, (3.66) 
(for any fixed subscript /) and 
A, (3.67) 
1=0 


are convergent. 
Similarly, series (3.65) is said to be convergent if the series 


B, = Pa any (3.68) 
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(with any fixed subscript k) and 


°° 


y Br (3.69) 


h=0 
are convergent. 
Let us introduce the notation 


A= lim ( lim Smn) i (3.70) 
nN—>oo \M——> 
Similarly, 
B= lim ci Smn) (3.71) 
m—>vo \n-— co 


A series for which all the a,, = 0 is called a double series with 
positive terms. 


If the double series y a,, and oe |a,,| are simultaneously 
k, [=o 
convergent, the double series is said nf be absolutely convergent. 


Whereas if > a,, is convergent, but 2 3 ane! is divergent, the 
k, [=o 


oo 


double series )° a,, is non-absolutely = conditionally) conver- 
k, lo 
gent. 


9. Some properties of double series 


I. If double series (3.61) and series (3.66), (3.67) are convergent, the 
iterated series (3.64) is also convergent and has the same as the double 
series. 

Similarly, the following property holds: 

Il. If double series (3.61) and series (3.68), (3.69) are convergent, 
iterated series (3.65) is also convergent, and has the same sum as the 
double series. 

REMARK. Generally speaking, the convergence of series (3.66) and 
(3-68) does not follow from the convergence of double series (3.61) 

III. The necessary and sufficient condition for the convergence of 
the double series (3.61) with positive terms is that its partial sums be 
bounded. 

IV. If one of the three series (3.61), (3.64) and (3.65) with positive 
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terms is convergent, the other two are convergent and have the same 
sum. 

A one-to-one correspondence can be established between pairs 
of equal terms of the double sequence {a,,} and the ordinary sequence 
{0}. We shall say for Brevity in this case that the double series 


y @,, and the series y b, consist of the same terms. 
k, l=0 s=0 


V. If the double series I a,, and the series > b, consist of 
k, To 
the same terms, the convergence of one implies the comveniehes of the 


other, and they have the same sum. 
VI. If the double series by 3 ana! is convergent, the series y ay) 
is convergent (but the sien oes not hold). a 
VII. If the double series y a,, and the series 5 5, consist 


k, l=0 sm 

of the same terms, the absolute convergence of one implies the absolute 
convergence of the other. Both series now have the same sum. 

VII. The terms of an absolutely convergent series can be rearranged 
in any manner without changing the sum. 

The above properties can be useful in proving the convergence, 
and computing the sum of a double series, 

EXAMPLE 24. It is easily shown that the double series 


= 1 
—_— 3.72 
neo KD Gi) 


is convergent for a> 2 and divergent for « = 2. 
For, on putting k+/ = m, we find that m—1 terms of series (3.72) 
are equal to 1/m*. Series (3.72) can therefore be written as the simple 


series 


so m—1) & ] ee ol 
—_— = —_ - —. 3.73 
es m* es m1 es m* ¢ ) 


Both the series on the right-hand side of (3.73) are convergent for 
«> 2 (Example 15), so that the series on the left-hand side is conver- 
gent. By Property V of double series, the double series (3.72) is also 
convergent, and its sum is equal to the sum of the simple series (3.73). 
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10. Some convergence tests for double series of positive terms. 
Estimates of remainder term 


A necessary condition for the convergence of any double series 


> ay, is that 
k, [=o . 
lim a, = 0, (3.74) 
k—> oo 
l—> co 


when k and | tend to infinity independently of each other. 

A stricter necessary condition than (3.74) can be given for the con- 
vergence of double series with positive terms. 

For a double series with positive terms to be convergent, it is necessary 
that 


lim x ayy = 0 (3.75) 
k—> co l=0 

and 
lim y apy = 0, (3.76) 
l—> co k=O 


so that all the more, the following conditions must be satisfied: 


lim DY aps 0 (3.77) 
h— co l=0 
and 
lim y apy = 0. (3.78) 
l—> co kmQ 


From (3.77) and (3.78), we see that the following conditions must 
also be satisfied: 
lim apy = 0, 
ies 


Rape a4 = 0 for any I, (3.79) 


ae a, = 0 for any k. 
l—> oo 
As in the case of ordinary series with positive terms (see § 1, sec. 
3~5), comparison of the terms of two series leads to a number of gene- 
ral tests for the convergence of double series with positive terms, and 
corresponding remainder term estimates can be given. 
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Suppose we have the double series 


oo 


Don (3.80) 


R, l=0 


with positive terms, and some other series 
»» Bp (3.81) 
k, Tmo 


We assume that the convergence or the sum of the series (3.81) is 
known to us in advance. We introduce the notation: k+/] = n, 


tim 2M = A, (3.82) 
nape kl 

Tes eer (3.83) 
n—> co Ap) 


In the case when A = A, we have 


fn (3.84) 


n— co Ap) 


The remainder term of double series (3.80) will be defined by 


Rinm = tmotlom +!mm (3.85) 
where 
heoo, lem—1 hem—1, lmco 
’no = aa, Tom = ap) 
kam, lwo k=O, [=m 
and 


'mm >= " 2, api 

We shall write B,,,, for expression (3.85), corresponding to the 
remainder term of series (3.81). 

Using the above notation, the following general sufficiency tests 
can be stated for the convergence of the double series (3.80): 

1°. If0 = Byyy< + for allm> N and A> 0, the series is convergent. 

2°. If—o <B,,,, = 0 for all m> N and A< 0, the series is converg- 
ent. 

3°. If, with finite A and A of thesame sign, Bin = + c, the series 
is divergent. ~ 
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4. If 0<Bam< +o for all m=>WN, and the conditions 
—-0o<A~< +oandA = + ~are satisfied, the series is convergent. 

5°. If — © < Brim < 0 for m> N and the conditions — 0 < A <0 
and A = — ~ are Satisfied, the series is convergent. 

When series (3.80) is convergent, the following estimates hold 
for the remainder term: 


(3.86) 
hk+lZ=m py k+l=m Gp 
When 4 = + © or A=-—e(or 4=+>-), 


| Bin | 
bet 
an 


Ram = . (3.87) 
inf 
k+l=m 








Further, on choosing the 5,, by different methods, we can obtain 
from the above general convergence tests various practical tests which 
are sufficient for the convergence of a double series with positive 
terms. Inequalities (3.86) and (3.87) enable us to give remainder term 
estimates corresponding to the convergence test chosen. 

We shall confine ourselves here to oneconcrete case, e.g. by putting 


Dat = Anas, 141 — Iho, 1 A, 141 + Fae (3.88) 


It now follows from the above general tests that the double series 


> ay, is convergent if: 


k, T=o 
(1) lim app = 0; (3.89) 
po 
(2) A= lim Pn > 0; (3.90) 
RTS oo Fh 
and is divergent if: 
go) Gn ObG (3.91) 
k+l—> co Tn 


The remainder term estimate corresponding to this test has the 
form 
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amo + 40m — 2mm <=R = Amo + 2om — Imm (3.92) 
— mm = ——~ 95 2. 
sup Pn inf Pat 
k+lZm Gp} h+l=m Gp 


where 6,, is given by equation (3.88). 

Fulfilment of condition (3.90) only is not sufficient for convergence 
of the double series. 

EXAMPLE 25. The series 


LOG) 


is obviously seen to be divergent; at the same time, the condition 
A = 0:1>0 is satisfied although lim a,, = ~. 


PP 
poco 
EXAMPLE 26. Let us take the double series 
+ 1 
= 2, EeD ED (3.93) 
Condition (3.89) is satisfied here, since 
lim a ue : 
pare pol PtHP 
We have by (3.90): 
fim PA fm Stat Sa te Aha TE Oe 
h+l—»co Gp R+1-> 00 Cnt 
ans for fixed /; 
+ 
= (k+1) (141) _ J k+1 
= Micrel (k+2) (+2) = ky+2 for fixed k; 


1, if simultaneously 
k and |]-+ ©, 
But obviously, = = (/+1D/7+2)s 1 and ss (A+1)/(kK+2) = 1 
ie. A = > for all k, 12 0. Series (3.93) is thus convergent. 


To estimate R,,,, in accordance with (3.92), we first observe that, 
for the function F(x, y) = (x+1) (y+1)/(*+2) (y+2), necessary 
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conditions for an extremum: OF/0x = OF/0y = 0, are not satisfied 
for any finite positive x and y, i.e. the greatest and least values 
of the function can only be attained on the boundary of the domain 
MBX, p<. 

Jt may easily be shown by using this fact that 


a 


and 
. (K+ 1) 0+) _ 
neizm (kK+2)(14+2) 


On substituting the values obtained in inequality (3.92), we get 


2 1 4(m +2) 2(m +2) 


G+! me hie Fem = Gas iad! Gt lon+ Die 


For instance, we obtain with m = 4: 
0-0159 3 Rm = 0-0382. 


§ 2. Series of functions 


1. Fundamental properties and convergence tests 


We shall discuss functional series in this article, i.e. series whose 
terms are functions. We shall confine ourselves simplicity to the series 


u(x) +(x) +... tig( +... = py u(x), (3.94) 


the terms of which are functions of a single variable. Immediate 
generalization is possible to the case of two or more variables. 
DEFINITION. The expression (3.94) is called a functional series; 
it is formed from the terms of the function sequence {u,(x)}, defined 
on the set X = {x} of the numerical axis E,, and has a corresponding 


sequence {s,}: 
nr 


Ss, = D3 u,(x) 


R=1 
of partial sums. 
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There are different types of convergence for the function s,(x): 
uniform, non-uniform, in the mean, etc. Corresponding to these we 
have different forms of convergence of the functional series. 

Let the sequence {s,(x)} be uniformly (non-uniformly) convergent 
on X to the function S(x). Series (3.94) is then said to be uniformly 
(non-uniformly) convergent, and S(x) is its sum: 


S(x) = Dy ty(X). (3.95) 


A Condition for Uniform Convergence of a Series: The necessary 
and sufficient condition: for series (3-94) to be uniformly convergent 
on X is that, given any e>0, there exists an N independent of x such 
that, given any n>N and any m = 1, 2, 3,..., the inequulity 


Sy une) 


ken+1 


<€E 








holds for all x € X. 
If all the terms of series (3.94), uniformly convergent on the set X, 
are multiplied by the same function v(x), bounded on X, 


v(x) = M, 
the uniform convergence is preserved. 
Tests for uniform convergence of series. 


1°. WErERSTRASS’S TEST. Jf the terms of series (3.94) satisfy on the 
set X the inequalities 


| Up(x)| = Cy (2 = 1, 2, 3,...), (3.96) 


where c,, are the terms of a convergent numerical series, (3.94) is uni- 
formly convergent on X. 
When (3.96) holds, the series 


we 


n=) 


is described as majorant for series (3.94). A functional series satisfying 
Weierstrass’s test is absolutely convergent, and moreover, the series 


S| ug(x) |. 
nel 


is uniformly convergent. 
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Cases are possible when series (3.94) is uniformly but not absolutely 
convergent. 
The following tests hold for functional series of the form 


2» Ay (X)by(x) = a,(x)by(x) +... +4,(x)ba(x)+ .... (3.97) 
n= 

2°. ABEL’s TEST. Series (3.97) is uniformly convergent on a set X 
if the series 


> by(x) = 5,(x)+0,(x)+ ..- (3.98) 


is uniformly convergent on the set X, while the functions a,(x) form 
a monotonic sequence for any x, and are bounded for any x and n: 


|a,(x)| = K. 


3°. DiricHLet’s Test. Series (3.97) is uniformly convergent on 
the set X if the partial sums s,(x) of series (3-98) are bounded for 
all x and n: 
[s,(x)| = M, 


while the functions a,(x) form, for any x, a@ monotonic sequence, uni- 
formly convergent to zero on the set X. 

Let us also note some properties of the sum of a functional series. 
If the functions u,(x) of series (3.94) are defined in the interval 
X = (a, 5) and are all continuous at the point x = x, of this interval, 
and in addition, series (3.94) is uniformly convergent, the sum S(x) 
of the series is also continuous at. the point x = Xp. 

The following proposition is a consequence of this: if the functions 
u,(x) are continuous throughout the interval Y = (a, 5) and if the 
series is uniformly convergent there, the sum S(x) of the series is 
continuous throughout the interval. The uniform convergence in 
these propositions is a sufficient but not a necessary condition, since 
there are series, non-uniformly convergent in an interval, having a 
sum continuous in the interval. We shall not state here necessary 
and sufficient conditions for continuity of the sum of a series, and 
shall only mention that uniform convergence is necessary and suffi- 
icent provided the terms of the series are in addition positive in the 
interval. 
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Term by term integration of series. If the terms u,(x) of series 
(3.94) are continuous in the interval X = (a, b) and the series is 
uniformly convergent in this interval, the integral of the sum S(x) of 
the series is equal to the sum of the integrals of the terms: 


| ’ SQ) dx = F | aL Ge. (3.99) 
a nel ja 


In other words, term by term integration of the series is permissible 
under these conditions. 

The following is a generalization of the above theorem: if the 
terms u,(x) of the series are integrable (in Riemann’s sense) in the 
interval XY = (a, b) while the series is uniformly convergent, the sum 
S(x) of the series will also be integrable and (3.99) will hold. 

Term by term differentiation of series. If the terms u,(x) of series 
(3.84) are defined in an interval X = (a, b) and have continuous 
derivatives u/(x) in X, and series (3.94) is convergent in X, while 
in addition the series formed from the derivatives 


E was) ius) tla) + oo bn) os 


is uniformly convergent, the sum S(x) of series (3.94) has a derivative 
in X, and 


S'(x) = x, u;,(x); (3.100) 


ne 
in other words, the derivative of the sum is equal to the sum of the 
series formed from the derivatives, i.e. term by term differentiation 
of series (3.94) is permissible. It may be mentioned that the restric- 
tions of this theorem can be somewhat relaxed (see ref. 11, vol. II, 


§ 407). 
2. Power series 


This branch of the theory of functional series is particularly import- 
ant. 
A series of the form 


py a,(xX—Xq)" = Ap +alx—Xo) +... +4,(x—X)"+... (3.101) 
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is called a power series. On substituting x, = x—Xx, (we shall omit 
the subscript 1), it reduces to the form 


Y ayx™ = Ag+ ax+anx*+ 2.6. +ayx"+..., (3.102) 
n=0 
with which we shall be concerned in what follows. 

There are three possible cases. 

Case 1. Series (3.102) is convergent for any real x, i.e. throughout 
the axis £,. In this case the series is said to be convergent everywhere. 

Case 2. Series (3.102) is convergent only for x = 0, The series is 
now Said to be divergent everywhere. 

Case 3. The series is convergent in some interval (—R, +R), 
0<R< +0; the number R is called the radius of convergence of 
the series. 

We shall accept the convention that Case | corresponds to a radius 
of convergence R = oo, and Case 2 toa radius of convergence R = 0. 

EXAMPLE 27. The series 
oo xn 1 x2 ar 
Dea = eas rtartart 
is convergent for any x (R = -), 

EXAMPLE 28. The series 


yi nix? = xt2bx?43l 4 .. 


n=l 
is convergent only for x = 0 (R = 0). 
EXAMPLE 29. The series 


y xt= L+x+x7+... 


n=l 


is convergent in the interval (-1, +1) (R= 1). 
EXAMPLE 30. The series 


peered 
on, ae ai 


is convergent in the semi-interval (—1, +1) (R = 1). 
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EXAMPLE 31. The series 





ae og x? a 
a ge ok ag 
fe ot 
is convergent in the segment [—1, +1] (R = 1). 
If the limit 
fin @n+1| _ 0 
noo} an ; 








exists, (see d’Alembert’s convergence test) then 


I 
R=—. 3.103 
; (3.103) 
(R = for g@=0, R= 0 for 9= ~). 
On starting from Cauchy’s test, we get 
R= = = =. (3.104) 
e@ lim yl4@,| 


If series (3.102) has a radius of convergence R > 0, no matter what 
the positive number r< R, series (3.102) is convergent uniformly 
with respect to x in the segment [—,, r]. 

The sum S(x) of series (3.102) is a continuous function of x for 
all x between — Rand R. 

THEOREM 7 (on the identity of power series). Jf two power series 


y a,x" and 3 b,x" 


n=0 nmd 


have the same sum in the neighbourhood of the point x = 0, the Series 
are identical, i.e. their corresponding coefficients are equal: a, = by. 

The following propositions concern the behaviour of a power series 
at the ends of the interval of convergence. If power series (3.102) 
is divergent at an end of the interval of convergence, the convergence 
cannot be uniform in the semi-interval (0, R). 
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The converse is: if the power series (3.102) is convergent forx=R 
(x =— R) (even non-absolutely,) the series is uniformly convergent 
throughout the segment {0, R] ( [—R, 0]). 

THEOREM 8 (Abel). Jf series (3.102) is convergent for x = R, its 
sum remains continuous (from the left) for this value of x, i.e. 


lim S(x) = S(R). 
x—>R-0 


See Example 30 for x = —R = —1and Example 31 forx = —R= 
= ~1, x=R=1. 


3. Operations on power series. Taylor series. Integration and 
differentiation of power series 


(a) Power series (3.102) can be integrated term by term in the 
segment [0, x], where [|x| < R: 


x Rad x oo xntl 
SQxdx = Yo | ayx™dx = Y a,——; 
0 n=0 0 n=0 n + 1 


x may reach the end of the segment at which series (3.102) is con- 
vergent. 

(b) Power series (3.102 ) can be differentiated term by term as many 
times as desired inside its segment of convergence: 


(3.105) 


Sx) = ¥ na,x™-}, 


n=l 
S(x) = yy n(n— 1)a,x"-?, 
=2 
S™(x) = 3 n(n—1)...(n—m-+1)a,x"-™; 
n=m 


this also holds for an end point of the segment at which the series is 
convergent. 

Taylor series. Different forms of the remainder term. A function 
expressible as a power series in its interval of convergence has deriy- 
atives of all orders inside the interval. The series itself is the Taylor 
series of the function. 
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If the function is expanded as a Taylor series in the neighbourhood 
of the point Xp, 


f%) = Y an(x— x0)" (3.106) 


n=0 


in this neighbourhood, where 


(n) 
a, = ee. (0! = 1). (3.107) 
The particular case of a Taylor series when x, = 0 is sometimes 
called a Maclaurin series. As follows from (3.106) and (3.107), it has 
the form 


f(x) = py nx (3.108) 
where 
(nO 


On confining ourselves to a finite number of terms in a Taylor 
series, a function f(x) can be written as a partial sum s,, of the series 
plus a remainder term r,: 


n co 
Sx) = Yi ax(x— xo) + Y ay(x— Xo) = Sn(X)+7n(x). (3.109) 
ke=o ken+1 

When x + xo, the remainder term r,(x) is an infinitesimal of order 
higher than n (compared with x—x,). There are various familiar 
forms of the remainder term of a Taylor series. 

The form of Schlémilch and Roche: 

(n+1) = 
r(x) = ee (1—6)"+3-7(x—x,)"+2. (3.110) 

Here p>0, O< 6<1 

On assigning concrete values to », we get more specialized forms 
of the remainder term: 

Lagrange’s form (p= n+1): 


(n+1) = 
are eel (xx)? @<6<1). (ll) 
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Cauchy’s form (p = 1): 


[Perot On all (1—6)" (x—x)"*2 <6 <1). 
(3.112) 


In spite of the indeterminate size of 0, these forms of the remainder 
term enable us to estimate the accuracy of replacing f(x) by the nth 
degree polynomial s,(x). If the (n+1)th derivative is bounded in 
absolute value in the interval between x and x, by the number M, 
we have from (3.111): 


r ‘n(X) = 


M | x—x,|"*} 
(n+1)! 
EXAMPLE 32. The Taylor expansion of the function f(x) = e* in 
the neighbourhood of the point xy = 0 is 


lra(x)| = 


x x x” 
e= Ita tat eee tay tra), 
where 
xntl xnt2 


rn(x) = Geb! t@sait Syetene 
By (3.111): 
et 
r,(x) = Gap” 


Here (when x>0): 


xt. 
Irn(x)| < * GED! . 
For instance, when x = 1: 
3 
Ira(1)| < ae! 


The remainder term can also be expressed in the integral form, 
which contains no indeterminate numbers: 


r(x) = a | f (n+0(t) (x— 1)" dt. (3.113) 
“ J xo 
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We can write, in the above example: 
J x 
A(X) = = | e'(x — t)" dt. 
nt |, 


Notice that a Taylor series may be convergent, and not represent 
its generating function f(x). 

ExampPLe 33 (Cauchy). Let (x) be a given function, expressible 
in the neighbourhood of x = 0 by the series 


(x) = 9(0)+ £0) 420 e+, (3.114) 


We add to it the function p(x) = e~!/"*. If we complete the 
definition of p(x) by putting y(0) = 0, both p(0) and all its derivatives 
py (0) vanish, so that the Taylor expansion of (x) in the neigh- 
bourhood of x = 0 is identically zero. But now: 


I) = (x) +9) = +20 42 O wy . (3.115) 


It is clear from this that equality of the expansions of the functions 
(3-114) and (3.115) does not allow us to deduce the equality of the 
left-hand sides: f(x) ¥ (x). 

In general, if two functions f(x) and (x) are equal at x = x, 
and all their derivatives are equal, while at the same time the functions 
are not identically equal, their Taylor expansions are nevertheless 
the same in the neighbourhood of x = Xo. 

Various operations on power series. Substitution of a series into a 
series. Suppose we have the series 


z= f0) = ataytayt...= Yay, (3.116) 


n=0 


convergent in the interval (—R, R). The variable y is expressible in 
turn as a power series in x: 


y = A(x) = bo +), x+hnxX+ ...= x, b,x", (3.117) 
nm’ 


convergent in the interval (—r, r). Say we want to express z as a 
power series in x and to find the interval of convergence of the series. 
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On formally substituting series (3.117) into series (3.116), we get 


z= ¥ Agx”, (3.118) 
n=0 
where 
Ag = Ap taybotabe+..., 
A, = a,b, + 2a,byb, + 3a3b2b, + ..., 
Ay = 


Oyby + dg(b3 + 2boby) + 2a5(b ob} + b2b2) +... 


The question of the convergence of series (3.118) is answered by 
THEOREM 9. 1°. Jf 
|dy| > R, 


series (3.118) is divergent, whereas, if 
| bo | = R, 
the series is convergent in the interval (— R,, Ry), where 


(R—| bolo 
R, = M+R—|by) ’ (3.119) 
o being an arbitrary positive number that satisfies the condition 0 <r 
and can be taken as close as desired to r, while M is the least upper 
bound of thenumbers |b,,|0™ (m = 1, 2, 3, ...), so that |b,,|o"= M 
or ail m. 
2°. If by = 0, series (3.118) will be convergent in an interval (—R,, 
Ry), where 
_ _e 
1 M+R 





3°. If the series z = > a,y" is convergent for all y, i.e. in the interval 
(— 2, + ©), series (3.118) will be convergent for |x|<r, i.e. in the 
interval (—r, r). 

Multiplication and division of power Series. 

THEOREM 10. The product of the series 


f(~) = > a,x" and (x)= ox b,x", 
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convergent respectively in the intervals 
I,=(—R, R) and 1,=(—R., Ro), 
is given by the equation 


Fla) = fla)p(%) = cobeyx tet... = 5 enx" 


where Cy = Agbo, C, = Agbi+aybo, Co = Agbp+a,b,+agbo, ete, 
and is convergent in the smaller of the intervals I,, Ih. 
The quotient of the division of 1 by the power series 1+ } b,x": 
n=l 


1 


fx) = —>——- 
1+ >” b,x” 


convergent in an interval (—r, r), is given by the series 
fe) = 14 At Ape 0. = 14 FAQ (3.120) 
n=1 


where A, = —b,, A, = b?—by, As = —b2+2b,b,—bs, etc. 
THEOREM 11. Series (3.120) is convergent in the interval (— o/ [M+ 1}, 
e/[M+1]), where 0 < 0 < r and @ can be taken as close as desired 
to r, while M is the least upper bound of the numbers |b,,|o"(m = 1, 
25 35. s22): 
We can easily pass from this to the division of one power series by 
another: 


1 Sea Dal 
WO) Dy Be Og pecs!” ep on 
We have neo 
ae = aa +,X+ gx? 4+ 2.) (LA + Ag+ ...), 
where 


1+ y A,x" = + 
= 1+) b,x" 
bo 1 
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is obtained as indicated above. The expansion 
Wx) Sin 
= VV cyx 
p(x) » x 


is now convergent in an interval determined by the above theorems. 


4. Complex series 


A numerical (or functional) complex series 


Sn (3.121) 


n=l 


is one in which the terms are complex numbers (or functions): 
Cp = An +ib,. (3,122) 


The convergence of complex series (3.121) to the sum S = 4+iB 
is equivalent to the convergence of two real series 


Ans (3.123) 


bas (3.124) 


to the sums A and B respectively. 
We have: 


THEOREM 12. If the positive series 
py jc, | = py Ja +52, (3.125) 


composed of the moduli of the terms of series (3.121), is convergent, 
series (3.121) is also convergent. 

In this case series (3.121) is said to be absolutely convergent. D’Alem- 
bert’s and Cauchy’s tests retain their validity for complex series. 
The theorem on rearrangement of the terms of a series and the rule 
for term by term multiplication of series can be carried over of abso- 
lutely convergent complex series. All the theorems on absolutely 
convergent real series retain their validity for absolutely convergent 
complex series. 
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Functions of a complex variable. If, for every value of a complex 
variable z from a domain Z in the complex plane, there is a corres- 
ponding single value of another complex variable w=u- iv, w is called 
a complex function of z in the domain Z and we write 


w = f(z). (3.126) 


If the function f(z) is expressible by a Taylor series in the neighbour- 
hood of the point Zp, i.e. can be expanded as a convergent power 
series in powers of (z—2Zp), it is called an analytic function of z at the 
point 2 . If f(z) is expressible as a power series in the neighbourhood 
of any point of the domain Z (open or closed), it is said to be an 
analytic function of z in the domain Z. Functions having this property 
are of the greatest interest in applied mathematics. 
The complex power series 


Y en(z—Z)” (3.127) 
n=0 
has a number of properties similar to those of real power series. 
We can consider in future, without loss of generality, the series 


See (3.128) 
n=0 

Since this series has a circle of convergence instead of an interval 
of convergence, the term radius of convergence acquires a strict mean- 
ing here. 

If the coefficients c,, of power series (3.127) are real numbers, the 
radius R of the circle of convergence coincides with the previous 
radius of convergence. 

The following proposition holds: if the series (3.128) is convergent 
at some point 2, of the circumference |z|=R, then as the point z 
approaches the point z, from inside the circle along a radius, we have 


fim: ¥ c.2" = Seach. 
zZ—>Zo N=0 nm0 
A complex power series can be differentiated term by term inside 
its circle of convergence. 
If a function is expanded, as a series in powers of z, the distance 
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from the origin (z = 0) to the nearest singulart point of the function 


is equal to the radius of convergence of the sum of the series. 


EXAMPLE 34. 


: = 1—2?4 24-784... + (—1)92"*4+ 0... = y (— 1)"z?", 
n=0 


1+2? 
(3.129) 
If we take the real axis z = x, the expansion 
1 24 x4 x6 
ie! > tlie oD, te Olle a (3.130) 


has a radius of convergence R = 1, although the function 1/(1+~x?) 
and its derivatives have no discontinuities on passing through the 
points +1. On returning to expansion (3.129) in the complex plane, 
we see that the function 1/(1+z?) has discontinuities at the points 
+i. This is in fact the reason for the divergence of expansion (3.130) 
for |x|> 1. 

If we introduce the notation c, = a,+ib,, (a,, 6, are real numbers), 
|z| = 7, arg z = 9, series (3.128) can be written in the form: 


hed oo 
¥ cn2™ = ¥ (ay +ib,)rret™® = 
n=0 n=0 


= y r™(a, + ib,)(cos nO +-i sin n6) = 


n=0 


= r™(ay, cos nO — b, sin nO) +i y r"(b, cos nO + a, sin 10). 


nod n=O 
Further, we have, on writing a,r" = A,, —b,r™ = B,: 
co eco 


y Cn2" = Yi (An cos n+ B, sinnd)+i Y (—B,cosnO + A, sinn6). 
n=O 


n=0 n=0 


The real and imaginary parts of the series are thus written as trigono- 
metric series. 


TA singular point is one in the neighbourhood of which a function is not 
expressible as a power series. 
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EXAMPLE 35. 





re ed Cl 


1 1 1—rcos6 


———  — 


l1—z 1—(rcos6+irsin@) 1—2rcos6+r? 


j rsin 0 
tar eos bar 


from which it follows that 


3 r® cos k6 +i ay r® sin kO, 


1—rcos@ h 
1—2rcos@+r? => eos 
rsin 6 h 
1—2r cos 6 +r? ou aay: 


5. Trigonometric Fourier series 


A function f(x) having a period 2xt (f{x)=f(x+22n), n= +1, +2...) 
can be expressed, under certain restrictions to be described below, 
as an infinite trigonometric Fourier series 


jaye +e (a, Cos nx +b, sin nx). (3.131) 


The Euler—Fourier formulae are used to find the coefficients of 
series (3.131): 


a =i f)cosnxdx (n=, 1,-2, ..), 
_ i (3.132) 
by els *_Ft3) sin mx (mn = 1, 2, 3,...). 


In order that ~ Fourier series (3.131) be convergent to the given 
function f(x), i.e. for its sum to be equal, at every point x, of the 


interval (0, 27), to the value f(x,) at this point, the function f(x) 
must satisfy certain conditions (see below, and Chapter IV, § 2, sec. 5). 


+ If the period of f(x) is equal to 2L, it can be transformed to the period 2x 
by bringing in the variable y=2x/L, so that all subsequent discussions retain 
their generality 
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THEOREM 13 (Localization theorem). The behaviour (i.e. converg- 
ence or divergence) of the Fourier series of the function f(x) at some 
point X9 depends exclusively on the values taken by the function in the 
immediate vicinity of the point Xo. 

The sum Sp of the series (3.131) for f(x) at x9 is determined as 
follows: 

(a) when f(x) is continuous at x», we have 


So = f(%»); 


(b) when f(x) has a discontinuity of the first kind at x (so that 
the limits f(x,+0) and f(x)—0) exist), we have 


5, _ fia+0)+/e%0-0) 
o7 2 ° 


We say that f(x) is smooth in the segment [a, b] if it has a conti- 
nuous derivative in this segment. 

A continuous function f(x) is described as piecewise smooth in 
the segment [a, b] if the segment can be split into a finite number 
of subsegments, on each of which f(x) is smooth. 

A discontinuous f(x) is described as piecewise smooth on the seg- 
ment [a, b] if: (1) it has only points of discontinuity of the first kind 
(and only a finite number of these) on the segment, (2) on each of the 
subsegments {«, 8] into which the original segment is split by the 
points of discontinuity, the continuous function 


f(+0) for x=a, 
g(x) = ) SQ) for a<x<, 
K@-9 for x=8 
is piecewise smooth. 

A convergence test for Fourier series. The Fourier series of a piece- 
wise smooth (continuous or discontinuous) function f(x) of period 27 
is convergent for all values of x, its sum being equal to So. 

If a piecewise smooth function f(x) is continuous everywhere, its 
Fourier series is absolutely and uniformly convergent. 

THEOREM 14. Let f(x) be an absolutely integrable function of period 
2x, continuous and possessing an absolutely integrable derivative in 
some segment [a, b] (the derivative may cease to exist at individual 
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points). The Fourier series is then uniformly convergent to f(x) in 
every segment [a+6, b—6] (6>0). 

This theorem holds, in particular, for an absolutely integrable 
(x) of period 2x, continuous and piecewise smooth on the segment 
[a, 5]. 


EXAMPLE 36. The function f(x) = —In/2 sin x , which becomes 


infinite for x =2ka (k = 0, +1, +2, ...), has period 27. Its Fourier 
series is 
cos 2x cos 3x 

+ 


—In 5) 3 


= COSx+ 








sae i 
2 sin 








THE DIRICHLET—JORDAN TEST. The Fourier series of a function 
S(x) is convergent at x, to the sum S, if the function is of bounded 
variation in some segment [xy— 6, Xo+ 4]. 

A more specialized statement is: 

DIRICHLET’s Test. If f(x) of period 2x is piecewise monotonic 
on a segment [—x, 2] and has a finite number of discontinuities there, 
then its Fourier series is convergent to the sum f(x») at every point 


of continuity and to the sum Sy) = > Lf(%o+0)+f(xp—9)] at every 


point of discontinuity (see Chapter IV, § 2, sec. 5). 
Dint’s Test. The Fourier series of a function f(x) is convergent at 
a point X» to the sum Sy if, given some h> 0, the integral 


i | p(t) | dt 
; t 


exists, where 
P(t) = f(%o +1) +f/%o— 1) — 2Sp. 
The following is a particular case of Dini’s test: 
Lipscuitz’s Test. The Fourier series of a function f(x) is conver- 
gent at a point Xo which it is continuous to the sum Sy = f(Xo) if, 
given sufficiently small t> Q, 


[f(xott)—f(%o)| S Lt, 


where L and « are positive constants (« = 1). 
In particular, piecewise differentiable functions are suited to this 
test. 
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The Dini and Dirichlet-Jordan tests are not consequences of one 
another. 

In the case of a function f(x), only specified on the semi-interval 
(—2, 2), or defined outside it but non-periodic, application of the 
above theory is made possible by replacing f(x) by an auxiliary func- 
tion f*(x), having the following properties: 


f*(x) = fx), (-7<x sn), 
f*(-2) = f*@), 
while f*(x) is extended to the remaining real values of x in accordance 
with the law of periodicity. 

All the above theorems and propositions are applicable to the 
function f*(x). The series represents the function f(x) inside the inter- 
val. 

This construction is not required if f(—2) = f(x). In this case 
the Fourier series isconvergent to f(x) throughout the open interval 
(excluding the ends). But outside the interval, the sum of the series 
in general no longer coincides with f(x), assuming the latter is defined 
throughout the real axis. 

On bearing in mind the footnote at the start of the present section, 
we can say that a function specified in any manner in any interval 
can be expanded as a trigonometric series in a very wide class of cases 
(this includes piecewise differentiable and piecewise monotonic 
functions) (see also Chapter IV, § 2, sec. 5). 

Expansions in sines only or cosines only. The Fourier series of an 
even function f(x)=(f(—x)) contains cosines only: 


ff) ~ 2 x Gn, COS NX. 
n=l 


The Fourier series of an odd function (f(x) = —f(—x)) contains 
sines only: 


IS) ~ y b,, sin nx. 
n=l 


Every function f(x), specified in the segment [—z, z], can be written 
as the sum of an even function f,(x) and an odd function f,(x): 


Sx) = fi@) +A), 
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where the component functions are 


f(x) —_ Sf) se Slx) WSC» | 


If a function is only specified in the segment [0, 2], we can define 
it arbitrarily in the interval [—z, 0] and thus obtain different Fourier 
series, Which will have a sum Sj at a point x, between 0 and x, the sum 


being convergent either to f(x») or to [itor O)+ f(xp—0)] (in the 


case of a discontinuity). 

If we complete the definition of the function in (—z, 0) as an even 
function, ice. put f(— x) = f(x), we get an expansion in cosines only; 
and if we complete it as an odd function (f(—x) = —/f(x)), we get 
aD expansion in sines only. 

EXAMPLE 37. f(x) =x(0S x57). 

(1) Let f(x) =f(—x) = —x(-xz5S x< 0); then 


x 4 cos 3x cos 5x 
fis) = 5-5 (cosa 32 +t). 





(2) Let f(x) = —f(-x) = x (-x< x <0); then 
uae sin 3x ) 

The order of the Fourier coefficients. If a periodic function f(x) has 
a finite number of discontinuities of the first kind (in a period), 
its Fourier coefficients will be infinitesimals of the form O(1/n) as 
n - oo (see Chapter 1, § 3, sec. 8 and 15). 

This means that 


n|a,|<M, n|b,|<M, 


where M is a constant positive number independent of n. 

If the periodic function f(x) is continuous everywhere, its Fourier 
coefficients will be infinitesimals of higher order than 1/n as n + ©, 
i.e. of the form o(1/n) (see Chapter I, § 3, sec. 8 and 15). 

This means that 


lim na, = lim nb, = 0. 
N—> co N~> co 
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If a periodic continuous function has continuous derivatives every- 
where up to and including the (m—1)th order, its Fourier coefficients 
a, and 6, will be of higher order than 1/n™ as n + ©, i.e. 

lim na, = lim n™b, = 0. 
Nn—> co N-> co 

In particular, if a periodic function f(x) has continuous derivatives 
of any order everywhere, its Fourier coefficients a, and ), satisfy 
the condition 


n™a, +0, n™b, +0 
as n — oo, independently of m. 
Integration of Fourier series. Let us first consider a continuous 
function f(x), specified everywhere on £,. 


THEOREM 15. Jf an absolutely integrable function f(x) is specified 
by its Fourier series: 


fx) ~ 2 + s (a, cos nx +b, sin nx), (3.133) 


r) 
we can find | J(x) dx by term by term integration of series (3.133), 
a 


independently of whether the latter is convergent or not, i.e. 


b a, © a,(sin nb— sin na)— b,(cos nb—cos na) 
dx = 2 (b-— EL ee A ie tig a 
i f(x) > ( ae 2 = 


(3.134) 


THEOREM 16. Let an absolutely integrable function be specified 
by its Fourier series (3.133) (convergent or not). The following 
Fourier expansion now holds for its integral: 


7 = 5 = —b, COS nx + (dy 
dx = > 20 n 
[. fo dx = Fon F 


(-z=<x<7). (3.135) 


+(—1)"*1a,) sin nx 
n 


A particular case of this theorem is when ay = 0 (the other condi- 
tions are retained); we now have for all x: 


(3.136) 


od <b ec 6—b, cos nx +a, sin nx 
dx = pauls pea A ae eet bes hee | eine 
[7 a ms n B X 


n=1 n 
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Differentiation of Fourier series. 


THEOREM 17. Let f(x) be a continuous function of period 2x, possess- 
ing an absolutely integrable derivative (which may not exist at a finite 
number of points). The Fourier series for f'(x) can now be obtained 
Srom the Fourier series (3.133) for f(x) by term by term differentiation: 


f'(x) ~ ¥ n(b, cos nx —a,, sin nx). (3.137) 
n= 
THEOREM 18. Let f(x) be a continuous function of period 2x, possess- 
ing m derivatives, the first m—1 derivatives being continuous, and 
the m-th absolutely integrable (the m-th m-ay cease to exist at a finite 
number of points). Now: (1) The Fourier series of all m derivatives 
can be obtained by term by term differentiation of the Fourier series 
for f(x), all these series, except possibly the last, being convergent 
to the corresponding derivative; (2) the following relationships hold 
for the Fourier coefficients of f(x) (see above): 
lim n™a, = lim n™b, = 0. (3.138) 
N—> co N-> co 
The series for f(x) and all the series obtained from it by term by 
term differentiation (except possibly the last) are uniformly convergent 
in this case. ; 
This theorem has the following converse. 
THEOREM 19. Given the trigonometric series 


D+ ¥ (a, 00s nx +b, sin nx), (3.139) 
n=l 


New 


if the following relationships hold for the coefficients a, and b,, 
|n™a,| = M, |n™b,| = M(m = 2, M = const), 


then the sum of the series is a continuous function of period 2x, pos- 
sessing m — 2 continuous derivatives, which may be obtained by term 
by term differentiation. 

THEOREM 20. Let f(x) be a continuous function specified on the 
segment [— 2, 2] and having an absolutely integrable derivative (which 
may cease,to exist at a finite number of points). Then 


fo~ ot ¥ [(nby +(—1)"c) cos nx— na, sin nx], (3.140) 
nel 
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where a,, and b,, are the Fourier coefficients of f(x), while the constant 
c is given by the equation 


1 
c= —[fln)-f(—m)}. @.141) 
THEOREM 21. Given the series 
2 + x (a, cos nx +b, sin nx), (3.142) 
n=l 


if the series 
5 + x (nb, + (— 1)"c) cos nx —na,, sin nx], (3.143) 
n=l 


where 
c= lim ((—1)"*'nd,], (3.144) 


is the Fourier series of an absolutely integrable function 9(x)f, 
x 
then the series (3.142) is the Fourier series of f(x) -| g(x) dx + 
oo 0 
+504 > a,, continuous for —n<x<2, and is convergent 
nel 
to this function, while obviously f'(x) = y(x) at all the points of 
continuity of ¢(x). 
THEOREM 22, Given the series 


24 y (— 1)" (a, cos nx +5, sin nx), (3.145) 
n=1 


where a, and b, are positive, if na,,nb,, do not increase (as froma 
certain n) and tend to zero as n-~ =, the series is convergent for 
—n < x <2 and has a differentiable sum f(x), where 


fi = Dy (~D"n(b,, cos nx— a, sin nx), 


ie. series (3.145) can be differentiated term by term. 

Similar theorems can be stated for functions specified on the seg- 
ment (0, z] (see for example ref. 10). 

Further information on trigonometric series will be found in 
Chapter IV. 


+ We do not assume the convergence of series (3.143). 
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6. Asymptotic series 


If a function F(x), defined for x = Xp, is to be considered for large 
values of the argument x, it is sometimes useful to find a function 
S(x) of simple structure such that 

R(x) = FO)-S(x) +0 as x+0@, 


In this case F(x) can be replaced by S(x) for large x. If F(x) admits 
of the expansion (for x> x,): 








ak FA An Ans = = An 
F(x) = Ag+ + stots te = aye? (3.146) 
we find, on putting 
= Vy f4ho gy yh An 
5,(x) = . = Aot Ste tS (3.147) 
and 
RA) = F)—s() = SF Aha 4mtty 3.148) 
n heHe1 xk nti ’ 
that 


lim x"R,(x)=0, or R,x)= o( 5a) : (3.149) 
N—> co x 
i.e. R,(x) is an infinitesimal of higher order than n. 

If F(x) does not admit of an expansion (3.146), it is still sometimes 
possible to choose a series of the form (3.146) such that condition 
(3.149) is satisfied for any fixed n. 

Series (3.147) is said to be asymptotic for F(x), and we write 

F(x) ~ Pe: : (3.150) 
Series (3.147) can be divergent, but it is still useful since it yields 
the approximate formulae 
A 
F(x) = Ay ae 


An 


art 


aan 


the degree of the approximation being indicated by (3.149). 
EXAMPLE 38. Let us consider the function 


iO = (aes 
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Repeated integration by parts gives: 


Fa) = 4-54 3-H Re, 


where 


—t 
By) = (— D8! [Fear 





co gt~t gknt |tsee 1 
—— dt = —-— -oen ls Cpe, 
a pyntt prt ies és pnt2 xrtl 
consequently, 
|Ra(x)| < 





rare 


and condition (3-149) is satisfied. Thus 


1 1 2! n-1@—1)! 
FQ) 6 Spt a= oe #(-1) aa ees 
This series is divergent, since 
—1)! 
lim ay = tim (~1p@= = 
n—> oo N—> co x 


If F(x) admits of an asymptotic expansion, this latter is unique. 
The asymptotic expansion of the product of two functions F(x) 
and G(x), each of which has an asymptotic expansion 


F(x) ~ » A,x7*, G(x) Ne > B,x7*, (3.151) 
k=0 k=0 
is formally equal to the product of asymptotic expansions (3.151): 
FX)G(x) ~ Yo Aye ® SY Bax =F Cyxm*, 3.152) 
where 

m 
= Y ApBm-e (3.153) 

h=o 


If the asymptotic expansion (3.150) of F(x) starts with the term 
A,x~*, it can be formally integrated term by term in the interval 
from x to + ©, i.e. 


[3 oo = Ap co 
i‘ F(x) dx ~ pz {. Sade = & sire : 
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Formal differentiation of asymptotic expansion is not permissible. 
If F(x) has an asymptotic expansion with no free term (A,= 0 and 
F(x) + 0 as x > ~), this expansion can be exponentiated 


FO 14 5 Fy ~ 
m=1 mM: 


Ay Ap An] 1 
wee [Be 4 sateee+ (3.154) 


The asymptotic expansion is thus a source of approximate formulae 
for computing a function for large values of its argument, the acc- 
uracy of formula (3.147) being the greater, the greater the value of 
the argument. 

There exist functions, not identically zero, for which all the coeffi- 
cients A, in the asymptotic form (3.150) are equal to zero. Such 
functions are described as asymptotic zeros. An asymptotic zero is 
any function F(x), for which 


F(x) = 0 (x) 


for any n. For example, F(x) = e~* is an asymptotic zero. Addition 
of this function to the left-hand side of (3.150) does not change its 
right-hand side. 

Not every function F(x), defined in the semi-interval [a, + ©], 
admits of an asymptotic expansion (3.150), but if such an expansion 
exists, it is unique for the given F(x) (the coefficients are uniquely 
defined). On the other hand, there exists for any sequence of numbers 
{A,} a function F(x), for which the A, are the coefficients of an 
asymptotic expansion (3.150). This F(x) is not uniquely defined, 
however (to an accuracy of an asymptotic zero). 


7. Some methods of generalized summation of divergent series 


Certain classes of divergent series, i.e. series lacking a sum in the 
ordinary sense of the word, are capable of generalized summation. 

The definition of generalized sum usually satisfies two condi- 
tions: 

1°. The linearity condition. If the generalized sum A corresponds 
to the series }'a,, and the generalized sum B to )\b,, the series 
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Y(pa,+9b,), where p and q are arbitrary constants, must have a 
generalized sum equal to pA+qB. 

2°. The permanence condition. If a series is convergent in the 
ordinary sense to the sum 4A, it must also have a generalized sum, 
equal to A. 

The general plan for constructing linear permanent methods of 
summation is as follows. 

Let 

Vo(%)s Vi%)s -+ +5 Yn(%)s ++ (3.155) 


be a sequence of functions given in a domain X of variation of the 
parameter x, and let X have a point of condensation — the finite or 
improper number ow. 

We construct, in accordance with the numerical series 


3 ay; (3.156) 
nad 
the functional series 
py OnYn(X)- » (3.157) 


If this series is convergent, at least for x sufficiently close to a, 
and its sum S(x) tends to a limit A as x ~ w, this number 4 is in 
fact taken as the generalized sum of series (3.156). To ensure that 
the method has permanence, two conditions are imposed on the 
functions y,(x): 


(1) lim y,(x) = 1 (n= 0, 1, 2,...); (3.158) 
(2) for all x € X: 
| WO+ YlrG)-raG)isK< — (K=const). (3.159) 


We shall next consider two methods of generalized summation, 
embraced by the general plan just described. 

1°. The method of power series (Poisson). In accordance with the 
given numerical series (3.156), we form the power series 


Y, AnX™ = Ay bax o 6. HA_X™ + 0005 (3.160) 


n=0 
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if this series is convergent in the interval 0 < x < 1 anditssum S(x) 
has the limit A as x > 1: 
lim S(x) = A, 


n-> 1-0 


the number 4 is called the generalized sum (in Poisson’s sense) of 
the given series (3.156). 
This method follows from the general scheme if we put 


‘Y= (0,1), w=1, y»(x)=2" (n= 0, 1, 2, ...).' 
EXAMPLE 39. Let us take the series discussed by Euler: 
1—1+1—1+1-1+.... (3.161) 
It has no sum in the ordinary sense, since s, oscillates between 0 and 
+1. The corresponding power series (3.160) has the form 
l—- x4 xP — x8 grt xd ol ya 


For 0 < x < 1, itssum (asthe sum of an infinite geometrical pro- 
gression) is equal to 


the generalized sum in Poisson’s sense of series (3.161) is 
ae tee (3.163) 
~ perineal +x 2° ° 
EXAMPLE 40. The series 
¥ sinnd  (-n 5022) (3.164) 


n=j 
is convergent only for 6=0 and 6= +z. The corresponding 
power series 
>. x" sin 76 (3.165) 


n=l 
has the sum, for 0O<x <1: 


x sin 6 


a) = 1-—2xcos@+ x? ° 
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The generalized sum is thus equal to 
A= lim ese IY ac, = 2D = ae ee 
x—+»1-9 1—2x cos 6 4x? 21—cos#) 2 2 
(3.166) 


2°. The method of arithmetic means (Cesaro). We take the partial 
sums 5, of the given numerical series (3.156): 
So = %, 51 = A +d, 


i (3.167) 
Sg = Ayo +a,+ a, eeey Sp, = Y ap 


and form their consecutive arithmetic means: 


BOT oS od, eee neh 55168) 


Ay = So, A, = 7) eee nt 


If the sequence {A,} has a limit A as n -> 00, we call A the generalized 
sum (in Cesaro’s sense) of series (3.156). 
This method follows from the general plan if we put 


jes for m=0,1,...,n—1, 
X=n, O= +02, y,(n) = n 
| 0 for mzn. 


EXAMPLE 41, Let us return to series (3.164), When » + 0: 


1 : 1 
cos = 4 —cos (n+5)2 


Sn = I ’ 
2 sin = 6 
ye  cotan 5 6— sin (ry DO — sind 
4 sin? — 0 
2 
1 0 
A= lim A, = —cotan—. 
wee oe 2 


We have thus obtained a generalized sum in Cesaro’s sense equal 
to the generalized sum in Poisson’s sense. 

The inter-relationship between the Cesaro and Poisson methods 
may be explained by quoting the following theorem: 
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THEOREM 23. (Frobenius). Jf a series is summable in accordance 
with the method of arithmetic means to the finite “sum” A, it is simul- 
taneously summable by the method of power series, to the same sum A. 

Notice that Poisson’s method is applicable to a wider class of 
Series than Cesaro’s method, though it does not contradict Cesaro’s 
method when both are applicable. 


§ 3. Methods of calculating the sum of a series 


We shall discuss in this section some methods of finite summation 
of series, some estimates for series, finite sums and products, and 
the problem, of importance for practical computation, of improving 
the convergence of series, i.e. methods enabling a given series to be 
replaced by another, having the same sum but more rapidly con- 
vergent. 


1. Elementary methods of exact summation 


It is very rarely possible to sum exactly an infinite series obtained 
as a result of solving some problem. Some simple methods of strict 
finite summation are given below. 


THEOREM 24. If the terms a, of the series ) a, can be written 


n=0 
in the form a, = b,—b,,, and if the b, form a sequence {b,} having 
a limit a, the sum of the series is 
S= ¥ a, =b—a. (3.169) 
n=0 


EXAMPLE 42. Suppose we have the series 


hed 1 
Py Jn(n4+1)(J/n+Jn41) : 
here 
1 


1 ] 
Van tt) (Jn+Jn+l) Jn Jn+l’ 


and lim 1/Vn = 0, so that S = 1 (b) = b, = 1). 


n—> co 
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THEOREM 25. If the terms of the series a, are expressible as 
n=0 


Gn = Gdn 41 t%edaret --» +&%pbneps (3.170) 


where p is some fixed positive integer = 2, b, form a sequence having 
a limit a, and a; are numbers satisfying the condition 


Xj +%y+... ta, = 0, (3.171) 
the series in question is convergent, and its sum is equal to 
S = aby +(x, +aqbgt 0. (eat o 6. Hypa )bpa + 
+ (%_ + 2% +3a,+(p~1)ep)a. (3.172) 
Exampte 43. Given the series 


4n+6 
noo (2 +1) (n+2)(n +3)’ 
we have 
4n +6 od 2 3 
(@+N@42a+3) ntl ’n¢2 nt3 


Consequently, a, = 1, a, = 2, a = —3. 
Condition (3.171) is satisfied : 1+2-3 =0. In addition, 5, = 
=1/n + 0 as n — o, We now find, by (3.172): 


1 5 
S=1l++D5=5. 
THEOREM 26. If the terms of the series } a, can be written as 
n=0 
a, = bn — Ong 


where q is a positive integer, while the sequence of numbers bo, by, 
ba, ... has a limit &, the sum of the series is 


Ss = x an = bp +b, + eee +b. 1-496. 
nw 


Tables of series expansions of functions and the relevant sections 
of reference works may be used for the finite summation of series. 
Given a particular series, it should be verified whether or not it 
is to be found in a reference book, or whether it can be transformed 
to a familiar series by a change of variable or some other means. 
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EXaMPLe 44, Suppose we have the series 
> kp* sinkx, |p| <1. 
Re1 


We find in ref. 7, formula 1.447 3, which we can write as 


1 1—p? 1 
h ice pS eS 
a? a 2 1—2pcosx+p? 2 Gpl= ). 


The uniform convergence of this series and the series of the deriva- 
tives of its terms with FeSpert to x follows from comparing them with 


the majorant series iH |p|* and x k|p|* respectively. On differen- 


tiating both sides of he entaiton with respect to x, we find the sum 
of the series (see § 2, sec. 1): 


— bho: _  p(i—p?) sin x 
a? sin kx an cos xp (|p| < 1). 


2. Summation of series with the aid of functions of a complex 
variable 


If the trigonometric series 


90.4 F a, cosnx = f,(2), (3.173) 
a+ 
y Gy Sinnx = f,(x) (3.174) 
T=] 


have positive coefficients a,, and the series )' a,/n is convergent, 
n=l] 
(3.173) and (3.174) are the Fourier series of continuous functions. 


We can sometimes find the functions f,(x) and f,(x) — the sums 
of series (3.173) and (3.174) — by making use of functions of a 
complex variable. 

Let 


pz) = e+ D nz” 
nel 


be the sum ofa series convergent in the circle |z] < 1. y lin g(z)= 
}z]—>1 
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= lim 9(re™) = o(e*), then f(x) +if,(x) = oe"), i.e. after separating 
die geal and imaginary parts of y(e“), we have: 
A(x) = Re {p(e*)}; (3.175) 
A(x) = Im {p(e*)}. (3.176) 


EXAMPLE 45. Let us establish the convergence and sum of the 
series 














cosx cos 2x 2 COS Nx 
I+ 5 +-3 + = l+y ml? (3.177) 
sinx sin2x ce sin nx 
i 7 Paas = Pa =e (3.178) 


The convergence of series (3.117) and (3.178) follows readily from 
a comparison with the series 


ao ] = 

M+ 
which is majorant for the given series. Furthermore, we put 
A eat Yr 
On expressing z in the exponential form z = re™ and letting r tend 


to 1, we have 


ee = eC0Sx+i Sinz — 9008 xcs (sin x) +i sin (sin x)] = 


¥ (cos x +7 sin x)" 


= 1+ 7 
Nm] n: 


> 


= = nx = si 
€°°8 ¥ cog (sin x) + ie°** sin (sin x)= 1+ 2 >) sin nx 











n! 
Hence, 
ty —= = 6°8* cos (sin x), (3.179) 
n=1 . 
by SIN TX _ e008 = sin (sin x). (3.180) 
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3. Summation of series with the aid of Laplace transforms 


Definition of the Laplace transform. Suppose that, given any x>0, 
the modulus of the function g(x) increases more slowly than some 
exponential function i.e. there exist numbers M and so, not depending 
on x, such that, for any x, 


| @(x) | < Mes, (3.181) 
Let p = s+io be a complex number. The integral 
a(p) = | ” e-Py(x) dx (3.182) 
0 


now exists and has derivatives of all orders in the half-plane 
Re p > So. The integral (3.182) is called the Laplace transform of (x). 
In the accepted brief terminology, (x) is the pre-image, and a(p) the 
image. 

Tables have been compiled for the pre-images and images of many 
functions (see for example ref. 7). 

Summation of numerical series (ref. 9). If, given the convergent 
infinite series 


S= 2 (+ Dta(k) (3.183) 
=1 
its terms are images of a pre-image 9(6), i.e. 
a(k) = { ” e-heg(e) de, 
0 


the following formula holds (preserving the correspondence of the 
+t signs): 





; _ 4 [7 @e 
5 cepaw = + [SE (3.184) 


EXAMPLE 46, Knowing that 


Qa oo 
——_ = hE oj 
Raa {. e-® sin af dé, 
we have by (3.184): 
= 1 _1/*sinaéd x bid 
2 Bae =7{, ors Walia Golan haa F 
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Generating functions. If the terms of the sequence {f,(t)} (k = 1, 
2, 3, ..-), defined in some interval a<t<f, are the coefficients or 
the Taylor expansion of a known function F(x, t) in powers of x fof 
|x| <1, ie. 


F(x, th= ¥ x*f,(t) (3.185) 
k=1 
F(x,t) is called the generating function of the sequence {f,(t)}. For 
example, one of the following sequences can be taken as {/,(t)}: 
(a) the sequence of powers ¢, t?, 15,..., where 


Fz, ) = 7 = o” xhgh, (3.186) 


and |xt| <1; 
(b) the sequence of trigonometric functions 


sint, sin2t, sin3t,... 


or 
cost, cos2t, cos 3t,... 
where 
= x sint a eae 
Fix, ) = qoosaie a3 x sin kt (3.187) 
and 
x cos t— x? = 
F(x, th= T=2x costpx8 = ee cos kt. (3.188) 


where ¢ can vary in any interval and |x|< 1; 
(c) the sequence of Chebyshev polynomials T,(x), T,(x), T3(x), .. «5 
for which the following relationship holds: 


F(x, t) = eee = = x"T,(t). (3.189) 


where |t|] = 1,|x]< 1; 
(d) the sequence of Legendre polynomials P,(t), P(t), Ps(t),..-, 
where 


F(x, t) = : -1= ¥ xP, (3.190) 


Jx?—2xt+1 Ret 


for |t| = 1 and |x| <1. 
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It should also be noticed that the infinite series (3.186)-(3.190) are 
convergent for x = + 1 or oscillate between finite limits (i.e. the 
sum of the first m terms remains less in absolute value than some 
constant independent of ¢ and m). 

The summation of functional series (ref. 9). Suppose that the 
generating function F(x, ¢) is known for an infinite sequence of 
functions {f,(1)} (k = 1, 2, 3,...) (see above). Let the series 


S(t, N= ¥. alk)x* f(t) (3.191) 


k=1 


be convergent in some intervale < t < Band for |x| $1. Ifthe coeffi- 
cients a(k) of series (3.191), considered as functions of the index 
k, are images of some 9(§), we have for the sum of series (3.191): 


S(t, ) = | ” le) Flxe~é, 1) dé, (3.192) 
0 


EXAMPLE 47, Knowing that the fraction 1/(K+/) is an image of 
e~* for any /=0 and k =0, i.e. 


] oo 
— = (RADE 
k+l i. = a, 


and using formulae (3.187), (3.188) and (3.192) for positive integral 
1, we have: 

co xk sin kt 
= 2, kel = 


ot ; mos Cr(— 1x" sin (r—De-+ sin | é 
rmQ. 


m=1 m 


sin It x sint 
2 In (1 — 2x cos ¢ + x*) + cos It arctan ~~ 





} ; (3.193) 


es xk cos kt 
S2(t, x) = a coe oy aa 


1 ej" ( as 1)"-1 m ; 
‘at | y [ Y Ch — 1x" cos (r— I) t— cos ul- 
: meal om r=0 


cos It xsint 


ear In (1—2x cos t+ x*)+ sin /t arc tan recon } . (3.194) 
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Formulae (3.193) and (3.194) remain valid for any ¢ and |x| =1, with 
the exception of points of discontinuity (ref. 11), which may make 
their appearance for the trigonometric series with x = +1. 

On making use of generating functions (3.186), (3.189), (3.190), as 
also (3.192) with positive integral /,: summation formulae similar to 
3.193) and (3.194) can be established for the series 





= th = x*T,(t) = x*p,(t) 
wear +1” Dy k+l a Py k+l 


4. Integral estimations for finite sums and infinite series 


Euler’s formula. If a function a(x) has derivatives up to and in- 
cluding the nth order for m= x Sk (mand k are positive integers), 
the following formula holds, due to Euler: 


y a(t) = i a(t) dt + De sr lae-M(k) — a®-1(m)] — 


tm 


1 h=1 
“a. Ya) Yame+i—p)dtt, (3.195) 


where Y,(t) = B(t)—B,, B, are Bernoulli numbers, B,(t) are 
Bernoulli polynomials (see Chapter VI). 


First integral estimate. We suppose that a™ (x) = Ott in the interval 
q= x3 p+! (p and gare positive integers). Let M4, denote the greatest, 
and m, the least, value of Y,,(¢) in the segment0 S11. The following 
inequality now holds: 


sn(P +1, \— TE [ap +1)—a-MQ)] =z YF alk) 2 
: =¢ 
5 5(P +1, )— 22 [a"MP+1)—a™—M@}, (3.196) 


t When n=1 we have to assume a3 (B,/»!) {a%—(k) —a%—Y(m)]=0; in 


addition, it is assumed here and chicaghont what follows that fO(x)= 1+ 
tt If a(x) #0, the inequality signs of (3.196) have to be reversed. 
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wheret 
+1 n=1 
Sx(P+1, 9) = | a(t) dt + 2 7s [a?-(_p +1) —a”-2(q)]. 
ou ‘ 


q 
Let us quote some values for M, and m,,: 


1 3 3 
M, = 1, m, =0; M, = 0, m= 73 “ m=; 
! 


=e: m= 0; M, = 0-0244582.. x= —0-0244582.... 


It can be shown that 


My = ¥u(z) >0O and m,=0, if J is even 


My =0 and my,= Y2, (z) <0, if Jis odd. 


If we make the following assumptions: 
(a) a™%x)20 for qax=<o~; 
(b) lim a™(x) = 0 for m=0, 1, 2,..., 7-1; 


£—> co 
(c) the integral } a(x)dx is convergent, 
q 
we now get, by (3.196), as p + oo: 
Me 
Sn (+2, 9+ —- en (= 


=F a a(t, 9) +72 a-1q), (3.197) 
=q . 
where 


Se ae i a(t) dt— "5 2 a-0(@, 
qg 


EXAMPLE 48. Knowing that the derivatives of any order of a(x) = 

=1 [vx are sign-definite in 1 = x = 101, we can estimate the sum 
s=¥4 

Ket Jk’ 


n= p 
+ When n=1, we have to assume oe Be tate—3) (p+1)—ale—1)(g)] =0. 


by making use of (3.196). 


We have, for instance, 
18-1< S < 19 -for n=1; 
18-55 < S$ < 18-61 for n=2; 
18-5890 < S < 18-5909 for n=6. 


Second integral estimate. If we assume that (—1)"~! a®™ (x) = Of 
for qx = ptl, the following inequality holds: 





B. 
Som-i(p +1, D+ Gmyl [a2™—-D(p 4 1) —a@m—-0(q)] = 


= YS alk) = smi(P+1, g, (3.198) 


hug 


where 
+1 2m-2 B 
Sam P +15 a) = |" al des Fe fey + D—a-4Q) 
Q Das . 


If we assume: 


(a) (-1)™1e2™_ =0t for gqex<+o 
(b) lim a@-Yy~)=0 for k=1, 2,..., m; 
x—> co 


* (c) integral | a(x) dx is convergent, 
qg 
the following holds: 


Som—i( + ©, 0-3; amg) = = a(k) = Sym_1(+ ©, 9), 
(3.199) 
where 
Soma + 7) = | : a(t) dt - os a-1)(g) tt, 


EXAMPLE 49, Knowing that, with a(x) = x°/, the following 
condition holds: (—1)* a!¥ (x) > 0 for all x > 0, we can carry out 
an estimate of the sum 


sS= 3, 
2 


tIf (—1)"—'a@™(x) = 0, the signs of inequalities (3.198) and (3.199) must 
be reversed. 


am—2 
tt When m=1, we have to put Y (B,/v)a”—(q) = Byala). 


vel 
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by making use of inequality (3.198) with m = 2. We have 
40501-2260 < S < 40501-2265. 
The first and second integral estimates may be used not only 
for evaluating finite sums and infinite series, but also for evaluating 


finite and infinite products. 
ExamPLe 50. Let us estimate the size of the product P = p!. 


P 
On taking logarithms, we have S = In P = )° Ink. 
kel 

Notice that the following conditions are satisfied for the function 

a(x) = In x in the interval J] = xsp+1: 
’ 1 ” 1 nr 2 

CX) > 0, ax= Saas 0 and a (x) = > 0. 

On using (3.196), say with n = 3, we get 


s(p +1, y—Bar+ H-a"(NsiPs 


= 5,(p+1, 1) ess [a"(p +1) —a"()], (3.200) 


where 


s+, D= (+3 7)ae+D- ab -rH| 


On exponentiating inequality (3.200), we finally get 


_¥3 (+p) Y3 (2+p)p 
Ly e ~ 216 (pti)? spis 15 (p+1)2 ; 








where 


1 1 
etme i? Te b+iprnl 


We next consider transformation of series for improving their 
convergence. 
5. Kummer’s transformation 

Suppose we have the series with positive terms: 


Ree Ya (3.201) 
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and some auxiliary series 
Bn = ¥. bp (3.202) 


nrn=m™m 
which is convergent and has a finite sum B,,. Suppose the finite limit 


exists: 
A= iim Pn #0. (3.203) 
n—> co dy 
In these circumstances series (3.201) is convergent (see Test III, § 1) 


and the following identity holds: 
Gols oe 3 (1-3 2) ths (3.204) 


which is known as Kummer’s transformation for the series (3.201)+ 


6. Improvement of the convergence of series corresponding to a 
given convergence test 


Transformation (3.204) can be used for improving the conver- 
gence of series (3.201). For, by (3.204), the convergence of (3.201) 
will be improved in the sense that the general term aW)= 
= (1-3 (yl) of the transformed series )° a) will tend 

nm 


to zero faster than a,, i.e. lim a/a, = 0. Obviously, the faster 
n—>oo 


the ratio 5,/a, tends to its finite limit A ~ 0, the faster the series 
on the right-hand side of (3.204) will converge. 

Transformation (3.204) can be applied several times in succession 
to the same series (3.201). 

Suppose, for example, that the terms of the auxiliary series 


Bw = yom (k = 0, 1, 2,..., p) 


nm 


are chosen successively so that 
(1) the sum B®) (k = 1, 2, ..., p) is already known to us; 


(%) (k) 
(2) 4, = lim A®, where A) = on , akt+)) = jae al), 
N—> ce af A, 


all the A, being bounded and non-zero. 
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Now, on putting A™/A, = 1—e”, where lim ec) = 0, we have 
after the pth transformation of (3.201): ad 
BH = 
Rn = + Yn TI (3.208) 
roo A k=Q 
_ It occasionally turns out that all the e = 0 for a certain k, 
and we get the strict sum of series (3.201). 
Every transformation of type (3.204) is determined by the choice 


of some series 3 b,, which corresponds to some test which is sufficient 
nel 
for the convergence of the series y a,, obtained from Test III. We can 
n=l 

say in this sense that, for every convergence test following from Test 
Ill, there is a corresponding method of improving the convergence 
of the series. It may prove convenient in practice to take all the b{, 
b®, b), ... equal or different in transformations (3.205), i.e. 
to choose the stages in the improvement of the convergence in accord- 
ance with the convergence obtained by using different tests. We 
shall consider below, as an example of the application of transfor- 
mation (3.205), methods of improving the convergence of series 
corresponding to d’Alembert’s and Gauss’s tests. 

Improvement of the convergence of series corresponding to d’ Alembert’s 
test. We put in identity (3.204): b, = a,,,—a, = 4a, and take 


the series }° a, to be convergent by d’Alembert’s test, ie 


neal 
lim ans - e< 1 
neo A, 
Let 0 ~ 0; then 
oo eo Ja. 
Bn = Sn B+ F (mF), 0.206 
nom 0 ne=m 0 
where 
Aventis: 
noe ay 


On again applying transformation (3.206) to the series 


= 4a 
y a, where a) = an——" 
n=m 0 
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= 1 A = 4 4 
i ey ia ==} 1S 
ae ™ = rat a,)an* 3, (! ale 5) 


The following notation is used here: 


14 Ma, A 4 
an (ta) dra (1-2) (I) 





Thus, p successive applications of the above transformation to the 
original series give (using the above notation): 





(k = 1, 2, 3, ..., p). 
Euler’s transformation. Given the power series 
Y ex" (3.208) 
n=1 


suppose that the following conditions are satisfied; 


o4 
lim 2# 21+ and lim —2#=1 3.209 
n—->oo an N—> co a ( ) 


(kK = 1, 2, ..., p). 


t+ This guarantees the convergence of series (3.208) with |x|~<1 (see ref. 
11, vol. I). 
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We can now apply to series (3.208) the transformation (3.207), which 
reduces to the following familiar Euler transformation: 


p= k+1 
¥ agxt = + p? fai =) * 


n=l] 


yee a). = (APo,)x". (3.210) 


EXAMPLE 51. Let «, = P(n) be a po lyaoniial of degree m; it is 
easily verified that conditions (3.209) are satisfied here for all k = m, 
while we have in addition 4*x,, = 0 for any k > m. Now, on applying 
(3.210), we obtain, for |x| < 1: 

: 1)x 
E Payer = FOe 


k+1 


+3 270 (35 z) ; 
Improvement of the convergence of series corresponding to Gauss’s 


test. Suppose that the series )' a, is convergent where the conditions 
nam 
of Gauss’s test are satisfied, i.e. 


Sats = m+ py) + 9(n) 
~ w+ gwT + y(n)’ 
where ¢(m) and y(n) have orders lower than n 


41—P1 > 1 (see § 1, sec. 5). 
If we put b, = (n+1)a,,,—7@,, transformation (3.204) can be 


A-1\ and in addition, 


applied to the series 5’ a,. We have 


n=m 
<= May, 
a4, = OT 
ain ar i oe 
oo 4p Am1 oA 2 ’ 
1 pn + p,n tee. +P; Ons (3.211) 


+G-n-1 nam M+gqnm i+... 44 


where pj, Py .--, P, are certain new coefficients not dependent 
on n. Transformation (3.204) for the series (3.211) can be repeated. 
Exampte 52. If transformation (3.211) is applied twice to the 
series 
anes 
ge n(n +1) 
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we get 
2 = 1 
S==+6 —_— oro: 
316) maa DarDars 
If we take into account only three terms of the last series, we get 
S = 59/60, while the exact sum is S = 1. 
EXAMPLE 53. Given the series 


S235 a. (3.212) 
where 
m= (e+) (B +H) 


e 
wo GaGa. oS Creare 


we can apply transformation (3.211) several times. We obtain after 
p transformations of the series (3.212): 
aB 
Ss =——> + 
vy —«—B) 


as “B Pat (yp +s—a)(yt+s—B8) 
wWy—«—B) no smo (V +541) (¥+5+1-a-8) 


(y+s—=)(y+s—B) & Qn 
pF Gears $y 
ee CEEEAE ET Gage) 
smQ 


+ 


7. Abel’s transformation 
The identity 


n n-1l 
Py By = &nBn + > (ap — 41) Br, (3.213) 


k 
where B, = >. B,, is called Abel’s transformation. It is the analogue 
isi 
of the formula for integration by parts of finite sums. On letting 
k ~ coin (3.213), we arrive at infinite sequences {a,} and {8,}. 
It follows from (3.213), provided {B,} is bounded and lima, = 0, that 
R—> co 


¥ anbe = ¥ (a ane Be (3.214) 


kel kel 
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This transformation can be utilized for improving the convergence 


of infinite series (see ref. 1). 
EXAMPLE 54. Let us improve the convergence of the trigonometric 


series 


ce oo 
D um sinkx and ) u,coskx, where lim, = 0, 
ket Re 


1 
cos (+ 3) x 


with the knowledge that 


R, 1 x 
Zao 5 cot a — 
2 sin— 
2 
and 
sin (+4) 
3 cos ix = SS 
i=] 2 sin = 


2 


On using transformation (3.214) after putting «, = u,, Ju, = 
= Up, —Up, We get: 








ao uy cot > 1 
), Me Sin kx = ——5—— + F dun cos( +7 xs 
a 2 sin = F=1 5 
By (3.215) 
= u, cos kx = -3- : ys Au, sin (K+3 )e (3.216) 
2 sin > so 


Obviously, these transformations of trigonometric series can 
conveniently be employed in the case when the u, tend to zero slowly 
and: ne 4u,/u, = 0. The improvement in the convergence will be 


the ereaied: the faster 4u,/u, tends to zero. 
If transformation (3.214) is applied a second time to series (3.215) 


and (3.216), we get 


Sasi roe epee) oe 
Py u, sin kx = (« 7) cot 5 





x Au, sin (k + 1)x 
4 sin? = *=2 
a 
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and 
y u, CoS kx = — + (u- Uz) a >, A*u, cos (k + 1)x, 
ae 4 sin? > ket 


where 4?u, = up, g—2up,, +, is a difference of the second order. 
For instance, if u, = 1/k, we have Ju, = 1/k(k+1), 


Au, = 2/k(k+1) (k+2), etc. 


8. A.N. Krylov’s method of improving the convergence of 
trigonometric series 


If f(x) satisfies Dirichlet’s conditions, it can be expanded as a 
convergent Fourier series: 


Sx) = B+ yx (a, cos nx + by, sin nx), (3.217) 
nel 


where the Fourier coefficients a, and b, are of order 1/n if f(x): 
is a function of bounded variation. Such a series is slowly convergent. 
It is possible to speed up the convergence by isolating the slowly 
convergent part. Let f(x) have bounded derivatives of the Ath order 
everywhere except for a finite number of points x{0), x(), ..., x{0). 
At these points f(x) has a discontinuity of the first kind, the size of 
the jump A, being equal to 


hy = f(x{) +0)—f(x -- 0) (i= 1,2, ... mo). (3.218) 


Suppose that the jth derivative also has discontinuities of the first: 
kind at the points x¥), x, ..., x, with jumps 


A = FOX) +0)— FOP —0) (3.219) 
Gal, 2,...,m; f21,2,..., 6. 


We can now write f(x) in the form 


fix) = YF = hia x— x1) + y — hPa (x—x)+ ... 


ms | 
vee + YS hPan(x— x) +(x), (3.220) 
t= 
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or 
1 & ‘ : 
fo) = 2% by WPa,x— x) +.9(%), (3.221) 
j= = 
where 
= for -—2x%<u<0O, 
@ sin nu 
i= Pa a — for O<u< 2x G2) 
0 for u= 0, 2x, ~27. 
ast) = [esta = — FSH 
0 
2 2. 
os Gey for -—2x%sus0O, 
12 4 : 
= ats (n—w? (3:223 
Va for OSus 2x 
Further integration gives us o,(u): 
o,(u) =. — Lo am eee sus2n). (3.224) 


The function y(x) is continuous along with its first k derivatives, 
and its Fourier series 


ox) = 4 y (&_ cos nx-+B, sin nx) 
ne 


is rapidly convergent, since the coefficients ~, and f, have the order 
1/n**+?, If we take into account the expansions (3.222)-(3.224), the 
series for f(x) will be 


f@) = ¥3 1 yp . sin n(x — x{) Bee 1 10 3 cos a xfP) 


n t=] 7 n=l 


ae ae ApS, See EY Bi 


t=) 7 nel 


+504 y (%, cos mx+B, sinnx). (3.225) 
nel 
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The slowly convergent parts have thus been separated out from 
Fourier series (3.217). 

We often obtain by some method the Fourier series for a function 
without knowing the function itself; here, if the series is slowly con- 
vergent, it is of little use for computing the values of the function, 
not to mention the values of its derivatives. It is often possible to 
improve the convergence in this case, by making use of familiar series 
for o(x—xX,), etc. This will be shown with the aid of an example 
(ref. 3). 

EXAMPLE 55. We are given the Fourier series 


4 
ncosn~ 


f(x) = ery y -T sin nx (Osx 382). (3.226) 
nel ne 


We separate out the lowest power 1/n from the coefficient: 


li cass Ee ped a 
e-l ante tee 


The initial series can now be split into three: 








cos n= cos n= 
f(x) = 2 y 2 aie 2 > sin nx 
Tnsi tne 
2 x Coss 





pe ir men sinnx, (3.227) 


The first two series are summable in the finite form: 





ee cosn = 
Six) = =7 Ol. sin nx = 
sinn( x+— sin 1 x-2 
Pipe be ossen Er) a WE 
ae n — 
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i cos n— 
S,(x) = apa oe “a sin nx = 
sin n Pye sin 
7 3 7 +sinn| x-— n 
1% ney nw = 


- - E (=+ z)* 0, (=-3)] . (3.229) 


| 
ya 

o 

IA 

* 

A 

N|a2 

NT 





x-7 n 
Si) =4 Zz F <xs *) ’ (3.230) 
0 (= = Z) : 
= wi Osxs a 

6x +24 ee oat ti 
SE Aaa . (3.231) 

_ 6x +54 7) (F ere). 

Consequently, 


2 2 cosn 2 
F(X) = S10) + 52x) - = py Bako yy sin mx (3.232) 


The remaining series is rapidly convergent (its coefficients are of 
order 1 /n®) and the expression (3. 232) obtained enables us to evaluate 
easily the values of the function and of its first derivatives. 

In the case when the series given above for gy, o,, o, are insufficient 
for improving the convergence, the following series may prove useful: 


cos x5 608 2x +5008 3x+ ...= 


= —Re[In|1—e*|] = ~1n|2sing (3.233) 
| 
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and its analogue: 


cos2x cos3x cos 4x 
i> 29. 7 34 








= (1—cos x) In 2 sin > +(3-3) sinx+cosx. (3.234) 


2 








By using these last series, we can improve the convergence of any 
series of the form 


= L\.. 1 + 
rl (4 (=) sin ro+B( 7) cos re) i nx + 
1\. 1 
+(C a sin 2Xy9+D Fy } S08 Xo } COS mx |, 


where A(1/n), B(1/n), C(1/n), D(1/n) are analytic functions of 1/n 
for small values of the argument. 


9. A. S. Maliev’s method of improving the convergence of 
trigonometric series 


The Fourier series of a function is slowly convergent if it has deri- 
vatives of all orders inside the interval (0, 27), while the function 
or one of its derivatives has different values at x = 0 and x = 2n. 
The following method was proposed by A. S. Maliev for obtaining 
a rapidly convergent trigonometric expansion of a function of this 
kind. 

Let f(x) be given in the interval (0, 2), where it has continuous 
derivatives up to and including the (k—1)th order and the kth 
derivative satisfies Dirichlet’s conditions. This function can be expand- 
ed as a series in functions cos 2nx and sin 2nx, or as a series in sin 
nx only or in cos nx only (depending on whether the continuation 
of f(x) into the interval (~2, 0) is even or odd). These series are 
in general slowly convergent. We can arrange for order 1/n*+} in 
the Fourier coefficient if we first continue the function into the 
interval (—z, 0) in such a way that, when continued periodically 
on to the whole of the real axis, the function has k derivatives, where 
the kth derivative satisfies Dirichlet’s conditions. 
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For this, we take f(x) in the interval (—z, 0) in the form, say, of 
a (2k— 1)th degree polynomial g(x), having, along with its derivatives 
up to the (k—1)th order, values at the points 0 and x, respectively, 
equal to the values of f(x) and its derivatives atx = 0 and x =a. 
We can conveniently choose (x) as 


G(x) = (x+2)* [ Aor at a 4 Ar-1 xho1 |+ 





em 


Bre 
+x [ B+ Bier +7)+ Per +r |. 


The coefficients Ap, A), ..., Ap_13 Bo, By, ..-, By, are now deter- 
mined successively from the equations: 
70) = 2*A,y = f(0), 
y'(0) = kx*t-14,4+2*A, = f'(0), 
p*-D(0) = Ce_k(kK—1)... 2Ag + Ch_yk(K— 1)... 307A, 4+. 
+ Chrtkr*-14,_. + Ch tnt Ay 4 =f 010); 
p(—7) = (—2)*By = fix), 
p'(—x) = k(—2)*-1By + (—7)*B, = f'(a), 
p&1—2) = Ch_yk(k—1)...2(—m) Bot 
+ Chyk(k—-1)...3(—2)?B, +. 
+ CRIK— zB, 1 = fP-Y(m). 
After constructing the polynomial g(x), we get the function 
g(x) for -xsx=0, 
p(x) = 
St) — for Osxsnx. 

This function, continued periodically, has k—1 continuous deriva- 
tives and a kth derivative satisfying Dirichlet’s conditions. The 
Fourier series for y(x) is as convergent as 1/n*+1 and yields f(x) in 
the interval (0, zz). 

EXAMPLE 56 (ref. 3). 


fx) = x5 Osxsn). 
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Let k = 3 (for convergence of the order 1/n*). Now, 
(x) = (x+27)% eee pes Cics 
PES Te Ts aA 
1 5 6 . 
cade | 
On expanding as a series the function 


w={ i (-7 =x 30), 
Wf) Osxsn), 


we get 


fa) = 2 ey ce ee >; J sin nx. 


1 
7 not, 58 .. n nm, 4, 6,... 


CHAPTER IV 


ORTHOGONAL SERIES AND 
ORTHOGONAL SYSTEMS 


Introduction 


A sequence of functions {f,(x)} is said to be orthogonal in the 
interval (a, 5) if, for i # j, 


(s Sif) dx = 0. 


An important role is played in analysis by the representations 
of functions as orthogonal series: 


> Cn Sax), 

nel 
i.e. series in an orthogonal system of functions. Trigonometric series 
are the classical example of orthogonal series. 

The theory of orthogonal series arose in connection with the 
solution of problems of mathematical physics by the so-called Fourier 
method. Linear integra] equations with symmetric kernels may also 
be solved by means of orthogonal series. 

The theory of orthogonal systems of functions has a remarkable 
analogy with the theory of orthogonal systems of vectors (see Chapter 
Il, § 1). This analogy was observed long ago and has been reflected 
in the terminology. It led in the course of time to the conception 
of Hilbert space — the infinite-dimensional analogue of n-dimensional 
Euclidean spaces (see Chapter II), the role of orthogonal systems 
of vectors being played in Hilbert spaces by orthogonal systems 
of functions. To provide a valid basis for the theory of orthogonal 
systems of functions, the basic concepts of analysis had to be gener- 
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alized; in particular, generalization of the concept of integral led 
to the Lebesgue integral. 

The more elementary part of the theory, and especially the “com- 
putational” side of it is described in the present chapter. Unless 
there is a special proviso, the integral is understood in Reimann’s 
sense throughout this chapter. 

n-dimensional vectors can be interpreted as functions defined at 
n points; this interpretation is discussed in broad outline in §1, 
sec. 1; it throws into greater relief the analogy with orthogonal series 
of functions. Biorthogonal systems of functions — the analogues of 
biorthogonal systems of vectors — are discussed in § 2, sec. 6. The 
first example of such a system was offered by P. L. Chebyshev in 
connection with interpolation problems. 

Orthogonal systems of functions are connected with problems 
of approximation of complicated functions by simpler ones, when 
the measure of the closeness of two functions f(x) and ¢(x) is provided 
by their square derivation: 


| ” Lf) — (a) a. 


The problem of the best approximation (from this point of view) 
of a function by polynomials led to the creation of the theory of 
orthogonal polynomials (the simplest system of orthogonal functions). 
The first example of an orthogonal system of polynomials was the 
system of Legendre polynomials. The general theory of orthogonal 
systems of polynomials is due to P.L. Chebyshev. This theory is 
described in § 3. 

The classical systems of orthogonal polynomials are discussed 
from a unified view-point in § 4, sec. 1-4. 

The later sections of § 4 are devoted to concrete systems of poly- 
nomials — those of Legendre, Jacobi, Chebyshev, Hermite, Laguerre 
(as also Chebyshev’s analogue of Legendre polynomials for a finite 
number of points), Good uniform approximations of functions 
can be obtained in a number of cases with the aid of segments of 
series in orthogonal polynomials. Such approximations are obtained 
very often from segments of series in Chebyshev polynomials (see 
§ 4, sec. 7). 


172 MATHEMATICAL ANALYSIS 


§ 1. Orthogonal systems 


1. Orthogonal systems of functions defined at 7 points 


Logically, the simplest example of an orthogonal system of functions 
is provided by a system of functions that are defined at n points. 
We shall confine ourselves to functions of one variable (everything 
said can be generalized immediately to functions of several variables). 

Let x,, x2, ..., X, be a finite set of numbers (or points of the 
real axis) and let f(x,) be functions defined at these points. Each 
such function can be regarded as a vector f with components f, = f(x;) 
(i= 1, 2, ..., ”). The length or norm of such a vector is 


Wril= [3 S%. (4.1) 
ie] 


The set of these vectors (functions) forms an n-dimensional Euclidean 
space, which is denoted by the symbol E,(x), %3, ..-,X,) (see Chap- 
ter ID). 

A basis in E, (xy, Xg,-.+) X,) iS any system of n linearly in- 
dependent functions f™, f®, ..., £™ on the set x3 %_, ..., Xp. 


2. Orthogonal systems in E,(x,, xg, ..-, Xn) 


Functions f(x,) and 9(x;) are orthogonal on a set of points xj, Xp, ..., 
Xyy if 


G9) = ¥ fi = Y faded = 0, 4.2) 


which corresponds to the orthogonality of the vectors with coordinates 
f,and (i= 1,2, ...,m). 
A system of functions f™ (x,) (k = 1,2, ..., J) of E, (1, as» +» Xn) 
is said to be orthogonal if 
(Ff, f) = | UfOIP> 0 for k=j, 


4.3 
0 for k #j. ) 


An orthogonal system of n functions is described as complete. 
There exists in E, (x, Xg, ..., X,) an infinite set of orthogonal 
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systems of n functions {f“} (j= 1, 2, ..., m); the functions of 
each such system form an orthogonal basis in space E,, (x;, X2, ..., Xn). 
Every function f(x,) of E, (x1, ..., X,) is linearly expressible in terms 
of the functions of an orthogonal basis: 


n 


fee) = Y of. (4.4) 


The coefficients c; in (4.4) are called the Fourier coefficients of the 
function fin the system of functions f™, f@, ..., f™, where 


5 = LF) = ¥ feed fC). (43) 


The coefficient c; is the projection of the vector f on to the base vec- 
tor f®, 

If || f || = 1 for all the (4 (j = 1, 2, ...,) of an orthogonal 
basis, the basis is said to be orthonormalized. If the basis f (j = 1, 2, 
..., m)is orthonormalized, we have for any function /(x,) of £, (x, 


Nas te ois ea) 


Iie = > 3, (4.6) 
j=1 


where the c; are the Fourier coefficients of the function fin the ortho- 
normalized system {f“} (this follows from (4.4) and the linear 
properties of the scalar product). 

If an orthogonal normed (|| f“ || = 1) system is not complete, i.e. 
the number of its elements / < n, instead of equation (4.6) we have 
the inequality 


t 
fir = Py ce (4.7) 
Equation (4.6) and inequality (4.7) transform in the limit as n — 


to Parseval’s equation and Bessel’s inequality respectively (see § 2, 
sec, 4). 
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3. The best mean square approximation 


The square approximation of a function f(x) by a function ¢(x) with 
respect to a system of points x), x2, ..., X, is defined by 


If—ell = [3 edo? 4.8) 


We shall discuss generalized polynomials of the Ith order, i.e. 
functions of the form 


> dy f?X(x;), (4.9) 


where {f™} (k = 1, 2, ..., J; 1< n) is an orthogonal system of 
functions of E, (x, Xg, ..., X,)- 

THEOREM |. From among all the “generalized polynomials” of the 
l-th order (1 = n), the best mean square approximation of a function 
S(x%;) at the points x, Xe, ..., X, is given by a polynomial of the form 

l 


Y enn), (4.10) 


kel 


where c, are Fourier coefficients. 
This /th order polynomial coincides with the sum of the first / 
terms of sum (4.4). This best approximation vanishes when / = n. 


4. Orthogonal systems of trigonometric functions 


The most important examples of orthogonal systems on a finite 
set of points are first the orthogonal systems of polynomials introduced 
by Chebyshev (see § 4, sec. 11), and secondly, orthogonal systems 
of trigonometric functions. 

EXAMPLE 1. The system of functions {cos kx,} (k = 0, 1, 2, ..., ”) 
is orthogonal on the system of 2” points x, = in/n (i= 0, +1, +2, 
..+, tn—1, —n). Any even function f(x,), defined at these points, 
is expressible by the sum 


n 
f(x,) == ee Cp COS Kx4y (4.11) 
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where 
= aaa >, fm) cos kx;. 


EXAMPLE 2. The system of n—1 functions {sin kx,} (k = 1,2, ..., 
n—1) is orthogonal on the system of 2n—1 points x; = iz/n (i= 
=+1, +2,..., +n—1, —n). Any odd function ¢(x,), defined at 
these points, is expressible as 

nol 
P(x) = DY cy sin kx, (4.12) 
kel 
where 


— ; 
Cc =— > x) sinkx,. 
n jan 


EXAMPLE 3. The system of 2 functions cos kx, sin /x, where 
k=0,1,2,...,2;/= 1, 2, ..., 2—1, is orthogonal on the system 
of 2 points 


4 == = 0, +1, +2,..., tn—1, —n). 


Any function (x,), defined at these points, is expressible as 


ae f+ (a, cos kx, + by sin kx,). (4.13) 
where 
= n= i p(x;) cos kx, 
x b= ie p(x,) sin kx,. 


Formula (4.13) reduces to (4.11) if p(x) is an even function, and 
to (4.12) if p(x) is odd. 

Any periodic function (x,), defined at all points x, = ix/n, where 
iis any integer, is expressible by (4.13), or by (4.11) or (4.12) if it 
is even or odd. 

These formulae, deduced by Euler and Lagrange, transform to 
(4. 42) and (4.43) asm -- oo, They are at the basis of numerical methods 
of harmonic analysis 
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§ 2. General properties of orthogonal and biorthogonal systems 


1. Orthogonality. Scalar (inner) product 


The orthogonality of two vectors in n-dimensional Euclidean 
space is well known to consist in the fact that their scalar product 
vanishes (see Chapter II, § 1, sec. 3), The orthogonality of functions 
is defined by analogy with the orthogonality of vectors. 

The scalar (inner) product of functions f(x) and g(x) on [a, b] is 
defined by the expression 


Ue) = | ” pela) dx. (4.14) 


(We naturally assume here that f(x).g(x) is integrable in [a, 5].) 
If 


Ue) = { ” dela) dx = 0, 


f(x) and g(x) are said to be orthogonal on [a, 5}. 

EXAMPLE 4. The functions sin x and cos x are orthogonal on the 
segment [0, x], since 

ies sin? x 
sin x cos x dx = 
I 

The orthogonality of functions with respect to a weight function 
is a further generalization of the concept of orthogonality. 

Let p(x) be a fixed non-negative function in [a, 5]. 

Any two functions f(x) and g(x), for which 


i ADeOp(a) de = 0, (4.15) 


0 








are said to be orthogonal on the segment [a,b] with respect to the 
weight p(x). 

EXAMPLE 5. The functions sin (m arc cos x) and cos (narccos x) are 
orthogonal on [—1, +1] with respect to the weight 1//1—x?, since 





+1. 1 
| sin-(n arc cos x) cos (m arc cos x) ax = 


= Ji-* 


= sin mu-cos nu du = 0. 
0 
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All the integrals considered in this chapter will be assumed to 
exist in Riemann’s sense. 


The concept of orthogonality can be generalized in a natural manner for 
functions f(x), g(x) and the weight p(x), which are Lebesgue but not Riemann 
integrable. 

Let p(x) be non-negative in (a, 5], non-zero on a set of measure zero and Lebesgue 
integrable on [a, 5}. Now, 


t 
| p(x) dx > 0. 
a 


Pb b 
Let f(x) be such that | 3(x) dx exists in the Lebesgue sense. Then | f* (x)p(x) dx 


a a 
also exists. We say in this case that f(x) is square integrable with respect to the 


weight p(x) on [a, 6] (in the Lebesgue sense), and we write L?,,,(a, 6) for the set 
of such functions. 

If p(x) a1, we use the simple notation L*(a, 5). 

For instance, the function f(x) =x"? belongs to L°(0, 1), whereas f(x) = x7!/? 
does not. 

The following proposition holds: if f(x) and g(x) belong to wa, 5), then 


b 
| S(x)a(x)p(x) dx 
a 


exists, and the Cauchy—Bunyakovskii inequality holds: 


b fo +;£[~6 
| SOg(x)p(x) dx = | | Pree de | 8°(x)p(x) dx 
a 


a a 


(this latter is a generalization of the corresponding inequality for vectors, see 
Chapter I, § 1, sec. 2). 

The scalar product in Lia (a, b) of functions f(x) and g(x) is defined by the 
expression 


b 
(fi 8) = | S(x)g(x)p(x) dx. 


a 


The functions f(x) and g(x) of L?,.,(a, 6) are said to be orthogonal with respect 
to the weight p(x) if (% g)=0. 


Let o(x) be a non-decreasing function in [a, 5]. Let us consider 
the functions f(x), for which the Stieltjes integral exists: 


l. f(x) do(x). 
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b 
In this case | (x) do(x) also exists. The set of such functions 


a 
will be denoted by L?,,.(a, b). 
There exists for any two functions f(x) and g(x) of L2,,,(a, 5): 


° S(x)g(x) do(x) (4.16) 


and the corresponding Cauchy—Bunyakovskii inequality holds. 
Integral (4.16) is called the scalar (inner) product of functions f(x) and 
g(x) of L3,,,(a, 5). 

The functions f(x) and g(x) are said to be orthogonal with respect 
to the integral weight o(x) if 


Le) = i flae(x) do(x) = 0, 


i.e. their scalar product vanishes. 
In the case when o(x) has a finite number of growth points: x, 
X2, .++) Xq, integral (4.16) becomes the finite sum 


¥ foxdeld lolx +0) 0%: — 0) (4.17) 


If all the jumps of o(x) are equal to 1, i.e. 
a(x; +0)—o(x,—0) = 1 
for all i, (4.17) becomes 


2 Aoxdetxo. (4.18) 


The orthogonality of f and g is influenced here only by their values 
at a finite number of points — the growth points of o(x). In this 
connection, the functions f and g can be regarded as specified only 
at these points (as in § 1, sec. ). In this case (4.18) is the ordinary 


scalar product of the vectors ri and zg of E,(x,, ..., x,). The case 
when o(x) has a finite number of growth points is piaular inasmuch 
as it is only in this case that there exist only n linearly independent 
mutually orthogonal functions (see § 1, sec. 1). 

The above concepts relating to the orthogonality of two functions 
are united by a common property: the inner product of the functions 
JS(x) and g(x) is in each case equal to zero. The whole of our sub- 
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sequent discussion (unless there is a special proviso) will be independent 
of the particular method by which the concept of inner product 
is introduced. We shall thus use in general the symbol (f, g) to denote 
the inner product of f(x) and g(x), i.e. this symbol may be defined in 
any of the ways described. The case when 


oe i Flex) dot). 


unites all the other definitions of scalar product. The case of a “differen- 
tial” weight p(x) is obtained from this when o(x) has an integrable 
derivative, and do(x) = p(x) dx, so that integral (4.16) becomes 


| ” Adete)plx) dx. 


Orthogonality without a weight is the case when do(x) = dx. The 
orthogonality of functions defined at a finite number of points corres- 
ponds to a finite number of growth points of o(x). 

In future, we shall therefore use expression (4.16) for (f, g), where 
necessary. 


The scalar product of the function f(x) with f(x), i.e. (4 f), is usually 


denoted by || /||? and || /]| =V/(C/S) is called the norm of the function. 
This quantity is the norm of f(x) in the corresponding normed space. 


The quantity 
ewtics | ” Cf g)8 do(x) 


is called the root square deviation of functions f(x) and g(x). This 
is the measure in the accepted sense of the closeness of f(x) and g(x). 


2. Orthogonal systems of Bessel functions, Haar functions, etc. 


Let any two functions of the sequence 


P(x); P(x), ae) Pn(x), sed, 
be orthogonal on (@, 5), i.e. (9;, y;) = 0 if i # j. 
Such a sequence is described as an orthogonal system of functions 
on (a, b). If the system of functions 


93(x), Po(x), «+, Pn(x), .-. 
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is orthogonal and each of the functions differs from zero, the system 
of functions 


— _ Pi) — 92%) — _Pnlx) 
© = Teco’? = Teco? 7 © = Te.GyI? 


is also orthogonal. Every function of this system satisfies 


px) Il = Vy. yp) = 1. (4.19) 
Such systems are extremely convenient. They are described as 
orthonormalized (or orthonormal). 
The orthogonal system 
9,(x), P2(X), eee | Pn(x), ore 


is said to-be complete in the space Li 9a, 5) if, among all the 
functions of L2 a, b), there is none that is non-zero and orthogonal 
to all the functions of the system 


P(X), P(X), «+> Pal), +++ 
ie. the fact that 


| ” fx) pa(x) do(x) = 0 


for all n, implies that 
f(x =0 


(excluding possibly a set of measure zero). 
In the case of a finite number of growth points of o(x), a complete 
system contains as many functions as there are growth points of 


o(x). 
EXAMPLE 6, The system of functions 


sin x, sin2x,..., sinnx, ... (4.20) 
is orthogonal on (0, 2), since 


e 
[/ sinmrsinncds = 0 for msn. 
0 


The system is complete. 
EXAMPLE 7. The system of functions 


1, cosx, cos2x, ..., Cosmx,... (4.21) 
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is orthogonal on (0, z), since 
= 
| cosmxcosmxdx=0 for m#n. 
0 


The system is complete. 
EXAMPLE 8. The system of functions 


1, sin x, cos x, sin 2x, cos 2x, ..., sin mx, cosmx, ... (4.22) 


is orthogonal on (0, 27), since 


2a 
| sinmxcosnxdx =Q for. any m anda, 
0 


2% 
| sinmxsinnxdx=Q for m#£n, 


2% 
} cosmxcosmxdx=0 for msn 
(m= 0, 1, 2,...;5 n=0, 1, 2,...), 


The system is complete. 
The system of Bessel functions. Let J,(x) be the Bessel function of 
order n, and A,, 4, ..., A; ... the positive roots of the equation 


J,(x) = 0 
or of the equation 
JR(x) = 0. 
The system of functions 


Ja(Arx),  In(4ax),  In(Asx), -- +, In(4ax), --- (4.23) 


is now orthogonal in [0, 1] with respect to the weight x, since with 
iff: 
i InlAyx)Iyldgxx dx = 0, 
0 

The system (4.23) is complete. 

The system of Haar functions. Inrecent times a use has been found 
for the orthogonal system of Haar functions. This system consists 
of piecewise constant functions y*(t), where 
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y(t) = _ 7 2 


xP =) _ 2 


0 

2 

WOW = = xa 
0 

2 

yP(t) = as “3 
0 

2 

420) = 29 
0 


- for r€ (0, 1); 


1 
for reo, z)’ 
for re(z, i], 


for t= 


for té€ [e 


for t€ (+ z\ 


at other points; 


1 3 
for rely. z) 
3 
for re(p i], 


at other points; 


8 ’ > 
at other points; 

1 5 
for te E ’ 3) ’ 

5 3 
for te (F ; | ’ 


at other points; 


(4.24) 
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3.67 
2 for te [7 zr) 
(47) 
WO) 2 for re(g i], 2p 


0 at other points. 


In general, 
gO) = V2", PP) = - VF. 


ei 2k—-2 2k—1\ 

/2" for té€ ae nti ), 
(ky) = 2k—1 2k 4.25 
Int) —./2" for 1e(Far |} : 


0 at other points [0, 1]. 


The Haar functions are generated from the “polygonal functions” 
of Schauder’s basis. The orthogonality of the Haar system follows 
from the fact that, given the same n, 

YP) =O for jek Zl, 
so that 
(a, af?) = 0. 
Given different subscripts m and n, where m> n, and any j and k 


the sub-intervals, where y‘*)(1) # 0 are wholly contained in the intervals 
of constancy of y(t) for m> n, and 


2k 
Qu+1 Qm am 
ii tin (t)xm (et) dt = 2 ic u(t) dt = a( ie - ace )- 0, 


Qut+h 








where 2 is the value of 72 on the interval of constancy. 

The system of Haar functions has an important approximation 
property: the Fourier series (see Chapter III) of any continuous function 
with respect to the Haar system is uniformly convergent to it in [0, 1]. 

The concept of orthogonality of functions of one variable on a 
segment may be generalized in a natural manner to functions of several 
variables, defined in some domain. __ 
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The functions f(P) and g(P) of a point P of n-dimensional space are 
said to be orthogonal with respect to a domain D of this space if 


| SP)e(P) AP = 0. (4.26) 
D 


A similar definition can be given of the orthogonality of f(P) and g(P) 
with respect to the weight k(P): 


| JI(P)g(P)k(P) dP = 0. (4.27) 
D 
EXAMPLE 9. The problem of the vibrations of a plane clamped mem- 
brane leads to the differential equation 
AU+iU = 0 


(where A is Laplace’s operator) with the boundary condition U = 0. 
The eigenfunctions of this equation, corresponding to different values 
of 4, are orthogonal: 


| | Us(x, Ula, 9) de dy = 0 
G 


EXAMPLE 10. Let @,(x), @2(x), . . , 9,(x),... beasystem of functions 
orthogonal on the segment [a, b]. The system of functions 


Ui, 1 Y) = PPO) (4.28) 
is now orthogonal with respect to area on the square a= xs 3B, 
asyzb. 

b fb 
For | PD BIOOCAMO) dx dy = 
ava 
b 7) 
=| pa(sdpn(x) dx | GMO) dy = 0, 
a a 


if either i + k or j # I, ie. if U, (x, y) and U, ,(x, y) are different 
functions of system (4.28). 

Systems of the form (4.28) are utilized, for example, in the expansion 
of the symmetric kernel of the integral equation 


ox) =A | ” K(x, s)o(s) ds+-fx) (4.29) 


as a series in the eigenfunctions of the equation. 
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If {y,(x)} is a normed system of eigenfunctions of (4.29), corres- 
ponding to the eigenvalues 1/A,, while {O;,(x)} is asystem of eigenfunc- 
tions corresponding to the zero eigenvalue, the system of functions 
(where i and j are arbitrary): 


PlX)Pi(s), Oix)P;(5), Pi(X)O;(5), O(%)O,(s), (4.30) 


is orthogonal on the square (2 S x S b; aS 5 5 5), since the system 
{p(x), 0,(x)} is orthogonal on [a, 5). 

System (4.30) is complete in the space of functions square integrable 
on (a3 xs 6b; ass )b). Hence the square integrable function 
K(x, s) can be expanded as a series in this system. The Fourier coeffi- 
cients of the function K(x, s) with respect to the functions 9,(x)p;(s) 
for i # j, O(x)p{s) and p(x)O,(s) vanish for any i and j, while with 
respect to the functions p,(x)p,(s) they are equal to 1/A,, by virtue of 
the relationships 


b fb 'b 
| | K(x, 0) 9(6) dx ds = { 


a 


p(x) dx { ” K(x, 5) ds = 


a 


» 
=+ pi(x)p(x)dx = 0, if i), 
Aste 


| i. K(x, s(x) O46) dx ds = | ” u(x) dx | ” K(x, 046) ds = 0, 


a 


| . | ” K(x, dp(adols) de ds = | ” g(a) dx I ” K(x, s)p(s) ds = 


aah iI. p(dodx) de = 


a 


Hence K(x, s) = 2 Zz Pi(x)9;(s). 


The concepts of orthogonality of functions with respect to surfaces 
and curves can be treated in the same way as the above orthogonality 
of functions in a domain D of n-dimensional space. For instance, the 
spherical Laplace functions are orthogonal with respect to the surface 
of a sphere. 
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3. Linear independence. The process of orthogonalization 


A system of 7 functions is said to be linearly independent if, given 
any system of m numerical factors, for which 


the function 4,9,(x)+A.9.(x)+...+4,9,(x) is non-zero. If there 
exists a system of factors A; such that 


AyGy(X) + AaPolx) +... +AnPa(x) = 0, (4.31) 


’ where at least one 4, differs from zero, the system of functions 9,(x), 
G2(X), - - +» Pp(X) iS said to be linearly dependent. (In the case of func- 
tions of L3(a, b), equation (4.31) can hold for a linearly independent 
system on a set of measure zero.) 

The concept of linear independence of functions is similar to the 
concept of linear independence of vectors of n-dimensional vector 
space (see Chapter II, § 1, sec. 4). 

Let the inner product (9,, 9;) be defined for any pair 9,(x), 9;(x) of 
the function system 9,(x), $2(x),-.-: Py (x). 

In analogy with the Gram determinant for a vector system (see 
Chapter I, § 1, sec. 5), we introduce the determinant 


(Pi, 1) (Pr, G2) «+- Gr Pn) 
On = (G2, Py) (G2; P2) eee (P2, Gn) ; (4.32) 


ee 


(Pas 71) Qn, 2) “8 (Pns Pn) 


which is called the Gram determinant of the function system. 

Properties of the Gram determinant. 1°. The Gram determinant 
A,, = 0 for any system of functions. 

2°, Let the system of function, 9), go, ..., v7, be defined on the seg- 
ment [a, b] and let the interval (a,, b,) be contained in (a, 5). 

Now, if 4, is the Gram determinant of the system in [a, 5] and 
(Y;, p;) 1s defined by 


b 
(Ps 9) = | pilpy(x) don) 
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while 4j, is the Gram determinant of the same system in [a;, 5,], 


we have 
4, = Ay. 


This property also holds for the Gram determinant of functions of 
several variables in a domain Q: the Gram determinant can only 
diminish when the domain diminishes. 

THEOREM 2. The necessary and sufficient condition for a finite system 
of functions to be linearly independent is that its Gram determinant 
be different from zero. 

_ THEOREM 3. Every finite orthogonal system of functions is linearly 
independent. 

Theorem 3 is an obvious consequence of Theorem 2, since the 
Gram determinant of an orthogonal system of functions is equal to 
the product of the squares of the norms of all the functions of the 
system, each of which is greater than zero. 

An infinite sequence of functions 9,(x), 92(x), .... Py(x), .-. 
is said to be linearly independent if any finite sub-system of it is linearly 
independent. 

Given the system 9, 2, ..., P, Of linearly independent functions 
and some function f(x), let us consider the problem of the best root 
square approximation of /(x) by means of linear combinations of 

n 
the system, i.e. from all the linear combinations )° dy, we find the 


tml 
one that gives a minimum for the expression - 


{= 2 a9; ; 














The coefficients of the best linear combination are found from the 
system of linear equations 


Oo 
ad, 


AP, 1) + do(Pa, P+ ++» +4n(Gn» OD = Ch Ds | 
Ar, P+ LlPx P2)+ -+- + dun P2) = (LP | (4399 


n 
f- ¥ 4g; 
im 














2 
)=0 (k = 1, 2,..., n), 


ie. 


(Pi, Pn) + 42(P2, Pn) + --- +4n(Pns Pn) = (4 Pn)- 
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The determinant of this system is the Gram determinant; in view 
of the linear independence of the initial system, it differs from zero 
and (4.33) has a unique solution. Obviously, it is easiest to find the 
coefficients d,, dp, .. ., d, from (4.33) if the initial system is orthogonal. 
In this case (4.33) becomes the system 


4m =O) k=1,2,..., 2). (4.34) 


By starting out from any (finite or infinite) linearly independent 
system of functions (or vectors), an orthogonal system can be formed, 
the elements of which are certain linear combinations of the elements 
of the initial system. Let us consider the process of forming such a 
system. It is called a Schmidt orthogonalization process. 

Suppose we are given the linearly independent system 


ys Papen 3305 Pyyra sd: 


We put 
9i{x) 
ox) = ———.. 
e @ oy? 
Let 


Po = Po(xX)— C210,(x). 


The coefficient c., can be chosen so that (y,, w,) = 0, by putting 


= Px 1) 1) = (P2, @). 


C = 
- (@,, @;) 3 


Having chosen such a ¢,,, we put 


w(x) = PX 
(pa, 2)? 
Here (., 2) # 0, since otherwise »,(x) = 0, and this would mean 
that ¢, and 9, are linearly dependent. 

Suppose that functions @,, @:,..., @,_, have already been found. 
We now put 


Pr(X) = val2)— "5, Cni®;(x), 


here the numbers c,,; are chosen so that ,(x) is orthogonal to all the 
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functions @,(x), ..., @,_,(x). We must take for this: c,; = (pp, @,). 
We next put w,(x) = y,(x)/(Ya» Yn), where (y,, ¥,) ¥ 0 in view of 
the linear independence of the functions 9, ..., P,_,. This process 
can be continued indefinitely. 

The system w,(x),...,@,(x),... thus formed will be orthonormalized 

The process of orthogonalization of a vector system is precisely 
similar. 

In the case of a vector system in n-dimensional space, or of a system 
of functions defined at m points, such a system contains not more than 
n elements. 


4. Fourier coefficients. Closed systems 


Let 
@,(X), W(x), ..., On(x), ... (4.35) 


be an orthonormal system of functions. Given a function f(x), suppose 
that its inner product exists with any function of the system. The 
numbers c, = (f, w,) are called the Fourier coefficients of f(x) with 
respect to system (4.35) In the particular case when (4.35) is a trigono- 
metric system, the c,; are the familiar Fourier coefficients of the theory 
of Fourier series. 

The Fourier coefficients of functions are the analogues of the pro- 
jections of a vector on to the vectors of an orthonormal vector system. 
If all the Fourier coefficients of a function exist, we can formally 
construct the series 


y Cp@p(X). (4.36) 
k=1 


This series is called (in analogy with the corresponding series with 
respect to the trigonometric system) the Fourier series of f(x) with 
respect to the system w(x), ..., @,(X),... - 

Bessel’s inequality and Parseval’s equation. We can write Bessel’s 
inequality for any f(x), for which (f, f) and all the Fourier coefficients 
exist: 

n 
1 Sh Sf), (4.37) 


1 


co) 
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from which it follows that the series }’ c? is convergent and 


i=. 
Lass fo. (4.38) 
= 
In the particular case when )' c? = (f,f), (4.38)is known as Parseval’s 
n=l 
equation. 
Let 


(x), W(x), ..., W(x), ... (4.39) 


be an orthonormal system of functions on (a, 8), and f(x) a function 
defined on (a, b) for which (f, f) exists. 

When considering the problem of the best root square approximation 
of f(x) by the linear combinations 


n 
Py d,w;(x), 
t=1 : 


we arrived (see sec. 3 of this article) at an expression for the coefficients 
of orthogonal system {w,(x)} giving the best approximation (4.34): 


a4= G @p) 
: (o,, @p) ; 
which yields in the case of a normed system: 
ad, = Cf, ®,) = Cy. 


From this there follows: 


n 
THEOREM 4, Ofall the linear combinations ¥. djw,(x), the finite Fourier 
sum fat 


3 c,00;(x) 
i=] 


has the least root square deviation from f(x) (i.e. the linear combination 
for which d, = ¢;). 

The orthonormal system w(x), ..., w,(x), ... iS said to be closed 
if Parseval’s equation is satisfied 


Fat = | P10 does (4.40) 
2 : 


t 
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for any function f(x) of L?,,.(a, 5). In this case, 
f. f(x) do(x) — x ci+0 as n+, 
@ ist 

which implies, in view of the equation 

b n 

| Fx) dota) — ¥ 8 =|" E fe) - 5 «oe | do(x) 
a oa a 


that the root square deviation 
b n 2 
| [ ¥- : <0] do(x) (4.41) 
a i= 


tends to zero as n+ ~. 
If (4.41) tends to zero as 2 + -, we say that the Fourier series 


py c,@;(x) 


is convergent in the mean to f(x). 

Consequently, if f(x) belongs to L?,,,(a, b), its Fourier series with 
respect to any closed system is convergent to it in the mean. 

EXAMPLE 11. The trigonometric system (4.22) is closed in (0, 27.) 

EXAMPLE 12. 

THEOREM 5 (V. A. Steklov). The set of eigenfunctions of the Sturm— 
Liouville equation forms a closed system. 

It was in the context of this theorem that V. A. Steklov introduced 
the concept of closure of a system. 

It follows from Parseval’s equation that every orthogonal system, 
closed in L345), is complete, and every complete orthogonal system 
in L?..)(a, 5) is closed. 


5. Fourier series in a trigonometric systemf 


The problem of representing an arbitrary function f(x) by a trigo- 
nometric series 


2 + ¥ (an cos nx +b, sin nx) (4.42) 
n=l 


+ See Chapter JII for more detailed information on trigonometric Fourier series. 
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arose in the middle of the eighteenth century in connection with the 
problem of the vibrations of a string. This problem occupied all the 
greatest mathematicians of this period. The essential step in the solu- 
tion of the problem was taken by Fourier, who established that, by 
virtue of the orthogonality of the trigonometric system, the coefficient 
of series (4.42) can be expressed in the form: 


dace = i ” f(x) dx, 
0 
a, => ° f(x) 008 nx de, (4.43) 
1 (2 : 
bn = an S(x) sin nx dx 


(hence the name Fourier coefficients in the case of any orthogona- 
system). 

Fourier stated the theorem to the effect that a (graphically) arbitrary 
function can be represented by a Fourier series. 

Historically, the first theorem on the convergence of Fourier series 
was: 

THEOREM 6 (Dirichlet, 1829). Any function that admits of integration 
in any interval in (0, 2%) and does not have an infinity of extrema in 
the interval can be expanded as a Fourier series, which is convergent at 
every point x to the value 


I(x +0) +/(x— 0) 
So 


The crucial point in Dirichlet’s proof was the representation of 
the partial sum s,(x) of the Fourier series and of the remainder in 
the form of integrals: 





2n+1 
SAX) = - Sf CE) da, 
‘ 2 





+ This had been noticed before Fourier by Euler. 
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and 


. 2n+1 
1s sin —> (x—«) 
Rees Sean) 
ss sin 


xX—& 
2 





da, 


together with the following observations: 


(1) if 0 < acd Tose aes es: 


2 
ii py ae dB + = (0); 


sin B 


Q)ifO<b<cs 3" and ¢(f) is monotonic, then 


[ir (8) Sat DB ag _. 0 ae aap aires 


sin B 


A rather more general theorem may be proved by the same method. 
TuHeEoREM 7. If f(x) is a function of bounded variation, its Fourier 


1 
series is convergent at every point x to the value z [f(x+0)+f/(x—-0)]. 


If, in addition, f(x) is continuous at every point of some interval, the 
Fourier series is uniformly convergent in the interval. 
THEOREM 8 (Lebesgue’s Test). Let 


P(t) = o(t) = f(x+D+fl(x—1—2f(x) 


and 
h 
O20) = |" Incl at 
lee) 
If 
P20) 9 as h-~+0O 
h 
and 


[ PR Bes Go dig, SD 


- t 


the Fourier series of f(x) is convergent to f(x) at the point x. 
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THEOREM 9 (Dini-Lipschitz). If f(x) is continuous and its modulus 
of continuity w(6) satisfies the condition 


c(8)In= + 0 as 6-0, 


the Fourier series of f(x) is uniformly convergent. 
THEOREM 10 (de la Vallée-Poussin). If the function 


] t 
w= [ oaltra 
O- 


is of bounded variation in some interval with left-hand end point t = 0 
and y(t) + 0 as t + 0, the Fourier series of f(x) is convergent at the 
point x to the value f(x). 

THEOREM 11 (Hardy). Jf 


1 \-2 
S(xt+h—f(x) =o[ (= 777) | 


and the coefficients c,, of the series have magnitudes of the order O(n-*), 
where 6 > 0, the Fourier series is convergent at the point x to the value 
S(x) (see Chapter I, § 3, sec. 8 regarding the symbols o(n) and O(n)). 


6. Biorthogonal systems of functions 
A biorthogonal system of functions on (a, b) is a system consisting 
of two sequences 


PolX)> P(X), P2(X)> ++» Pn(x), +++ } (4.44) 
Pox), Yilx), Po(X)> ++ +> Pr(X), --- 
satisfying the following condition on (a, 5): 
(Pir i) = 45, 
where 6,,; is the Kronecker delta (see Chapter II, § 1, sec. 2). Here, 
the inner product (y,, ;) is either Qi; ax or f gy; do(x). In 
a 


the latter case we speak of a system of functions, biorthogonal with 
respect to the weight o(x) or p(x), if do(x) = p(x) dx. 

Given any function, for which the inner products encountered later 
exist, we can associate with it the series 
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fe) ~ ¥ Aron, (4.45) 
where far as 


and consider the question of the convergence of the series and the 
possibility of using segments of it for approximation to the function. 

EXAMPLE 13. Chebyshev’s biorthogonal system on (—1, 1) with res- 
pect to the weight p(x) = 1 is 


. sin(k+1 
Pr(x) = sign NP ’ 
edule (4.46) 
‘ 2 aftr @ sing ” 
where x=cosp (k=0,1,2,...), 


while d in (4.46) runs over all odd divisors of k+1, including d = 1 
and d=k-+1 if this is odd; the function sign x was introduced in 
Chapter I, § 2, sec. 1; u(d) is the Mébius function, i.e. 

H(A) = 1; 

u(a) = 0, if a is divisible by a square different from unity; 

(a) = (—1)’, if a is not divisible by a square different from unity, 

and r is the number of prime divisors of a differing from 1. 

The functions ¢,(k) of this system are piecewise constant, while 
p,(x) are polynomials in x having k simple zeros in (—1, +1). The 
first few functions of this system are given below: 


-1 for -l<x<0O, 
1 for O=<x<1, 


-1 for -l<x< ee 
1 1 | 
p(x) = { +1 for i ea i y,(x) = 2(xt-5)), 


—1 for yea 
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1 


-1 in (- -=5): 


+1 in (-z 0), 


$5(X) = 1 a(x) = 2x(2x? — 1). 
-1 in ( =): 


Ma 

5 
o——s 
a 
= 


EXAMPLE 14. Markov’s biorthogonal system in (—1, +1) with respect 
to the weight p(x) = 1//1—x? is 


% = 1, Po = 
(4.47) 
Y, = Signcosky, y= 5 LG OSs 


where x = cos g, d in (4.47) runs over all add divisors of the number 
& that do not contain square factors, and A is the number of prime 
factors of the form 4m+1 contained in d(m # 0) (see Chapter I, 
§ 2, sec. 1, regarding the function sign x). 

Here, as in the Chebyshev system, g,(x) are piecewise constant, 
while »,(x) are polynomials in x. The first few functions of this system 
are given below: 


1 
Po = 1, Yor, 
x 
r(x) = 3° 


, 1 1 
-1 in (~~ =): vax) = > 2x?— 1), 


1 
+1 in —, 1), 
(az) 
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2 
+1 in (-3. 0), 2 
pals) = 00) = 2x( 8-3) 
—1 in (0 ae 
2 
+1 in (2. 1), 


Series in Chebyshev and Markov functions are similar to series in 
sines only or in cosines only. 

On passing from polynomials and the interval (—1, +1) to tri- 
gonometric sums and the interval (—z, +7), we can combine both 
systems into one, which generates series corresponding to trigono- 
metric series of a general type. 

A biorthogonal system is called a Chebyshev—Markov system with 
respect to the weight o(x), if ,(x) is a polynomial of degree k, and 


pa(x) = sign Q,(x), 
where Q,(x) is a polynomial of degree k. 

THEOREM 12. The biorthogonal Chebyshev—-Markov system for a 
given function a(x) is unique; the polynomial Q,(x) appearing in the 
expression for ,(x) is the polynomial of degree k with first coefficient 
1 for which 


i. | Ox(2)| do(x) = mi (" | Py(x) | dots). 
Ls Pxx) } 4 


The system of polynomials p,(x) is determined after this by means 
of a process similar to the Schmidt orthogonalization process (the 
metric of space L?,,. is the natural one when considering series in the 
Chebyshev—Markov system). 


§ 3. Orthogonal systems of polynomials 


Various systems of orthogonal polynomials were introduced by 
Legendre, Jacobi, Chebyshev and other mathematicians The first of 
these historically was the system of Legendre polynomials. Chebyshev’s 
studies laid the foundations ofthe general theory of systems of ortho- 
gonal polynomials. 


198 MATHEMATICAL ANALYSIS 


Let the system 
P,(x), P,(x), ooee P,(x), a | (4.48) 
where P,(x) is a polynomial of degree n, be orthogonal on (a, 5) 
(in particular, the interval may be infinite) in the sense that 
b 
(Pmy Pp) = | Py (2)P p(X) do(2), (4.49) 
a 
where o(x) has an infinite number of growth points (in particular 
do (x)= p(x)dx, where p(x) is integrable in (a, b)). Apart from a constant 
factor in the polynomials, the system (4.48) can be obtained by means 
of orthogonalization (see § 2, sec. 3) of the system of functions: 1, 
Xy, X%_,...x",... Let us agree to write P,(x) in future for polynomials 
of orthogonal system (4.48) defined by the condition that their first 
coefficient is equal to 1: 


P(x) = 1, Py(x) = xt+ayo, .- 


ne (4.50) 
oy Pa(x) =X" 44g, noyX" "1+... +One 
and P,(x) for polynomials of the orthonormal system, i.e. 
b a 
| P2(x) do(x) = 1. (4.51) 
@ 


The Fourier coefficients of f(x) in an expansion in polynomials 
{P,,(x)} have the form 


ae | ” AODP, (x) do(2). 
In particular, if do(x) = G(x) dx, we have 
— | OPQ) de, gl) = fGW). (4.52) 


Notice, that, to evaluate integral (4.52), it is not necessary to find the 
values of P(x) throughout the interval. On writing 


g(x) = gy(é)dé and for i>s o-\x) = ‘i g'-i+0() dé, 
a a 
we obtain, by integration by parts, 
Cn = G-DD)P, (b)— p2(b)Py (dB) + 6. (= 1) @K*-D(B) PM“). 


Therefore, to find the coefficients cy, ¢), . . ., Cm» We only need to find, 
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by successive integration of ¢(x), the values of p—)(b), o'—?(b), ..., 
y‘-™(b), the values of the polynomials P,(x) (k = 1, 2,...,m), and 
their m derivatives (for k = 0, 1, ..., m) at the point b. 


1. Zeros of orthogonal polynomials 


THEOREM 13. The n-th degree polynomial P,(x) of the orthogonal 
system (4.48) has n real distinct simple roots, all of which lie in (a, b). 

THEOREM 14. The zeros of the polynomials P,(x) and P,,_,(x) of 
system (4.48) alternate: between any two zeros of P,(x) there is a zero 
of Py»_,(x). 

It follows from Theorem 14 that P,,(x) and P,_,(x) have no common 
zeros, 

THEOREM 15. If A(x) is the number of changes of sign in the series 
P,(x), Py(x), ..-, P,(x), the number of roots of the polynomial P(x) 
in the interval (a, B) is equal to the difference \(«)—4(B) (the property of 
so-called Sturm systems). 


2. Recurrence relations for orthogonal polynomials 


Let P, +42(*); Pra i(®)s P(x) be any three successive polynomials of 
system (4.48), satisfying condition (4.50). In this case the following 
relationship holds: 


Proz(%) = (Xn 42)Pn4t(*)—AngiPa(®), (4.53) 
where the parameters ~,,,, and A,,, are given by: 


” Pa, (2) do(x) 
rn+2 = a7. > 
| P2, (x) do(x) 
a (4.54) 
Ba, (x) do(x) 


Aner = Se . 
P2(x) do(x) 


a 


Obviously, 4,,,> 0. 
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The parameters «,,, », 4,,, are expressible in terms of the coefficients 
of polynomials P,,.,5, Paoy Py: If 


— k-1 7 
P,(x) = x* + Y apsx, 
j=0 
then 
Sn+2 = Angin In+e, ntir 
Anat = 8n+1, n-1 — n429n41, n — In42, nv 


It follows from formulae (4.54) that, if (a, 5) is a finite interval, 
we have for all n: 


where 
aA<=Gi2< b, | 
0< Angi < c, (4.55) 
where c? = max(|lal, |6]). | 


For examples of such recurrence relations see § 4, sec. 5-10. 


3. Power moments. The expression of orthogonal polynomials in 
terms of power moments 


The numbers 
b 
in = { x" do(x) (4.56) 
a 


are called the power moments of the weight o(x). 
In the case of the system 


Dept eg My aes 
the pair-wise inner products are expressible in terms of the power 
moments: 


'b 
(xm, x) = | 2x9 do(2) = Ine 


a 
Gram’s determinant of the system of powers is ' 


y= ama eee #0. (4.57) 


ee ee eo eo we wo ow 
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The process of orthogonalization of a system of powers yields the 
expression for the polynomials P(x) of (4.51): 


Un Pne1 +++ Mena. *" 
and for the polynomials P,,(x) of (4.50): 





; Ho +++ Una 1 

P,(x) = Binet: OG (4.59) 
TM—1) . 2 © © oe ew ww ow 
Mn++ Hen-1 x" 


The parameters « and A of the recurrence relation (4.53) can also be 
expressed in terms of the power moments: 


Ho eee Bn Ua+2 
ae My oo ee Mngt Uns 





Ho +++ Pn-1 0 Pn41 
——| Hi --: Hn Hn+2 |, (4.60) 
Lo ae te rere rae 


Bn +++ Men-1 Landi 
where n = 0, 1, 2,...; 


Lt. — Ans14n-1 as 
oar aS Ane. = Ae (n= 0, 1, 2, ...), 


while 4_, = 1. 


4, The connection between orthogonal polynomials and continued 
fractions 


The fraction 


P,, (t)— Pn (x) 
t—x 
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is a symmetric polynomial of degree n—1 in tand x. Hence the function 
ee = 
Ra i PaO Pr) dott (4.61) 
. = 


is a polynomial of degree n—1 in x. 

The polynomials R,,, ,(x), R,(x) and R,_,(x) satisfy the same recurr- 
ence relation (4.53) as polynomials P, +2(%)» P, +1(%); P,(x). This 
fact indicates (see Chapter V) that R,_,(x) and P,(x) are respectively 
the numerator and denominator of the mth order convergent of a 
Chebyshev type continued fraction: 

A vies 
es fom Monk tr eagiae . (4.62) 
The polynomials R,,_ ,(x) are described as polynomials of the second 
kind with respect to the weight o(x). They are the denominators of 
the continued fraction 


a a 
we Ai st ceilal as ty ts 2 ag (4.63) 


X— Aq X— My X—On4y 


and are orthogonal with respect to some other weight. 

If the interval (a, b) is finite, the sequence R,_1(x)/P,() of conver- 
gents of the continued fraction (4.62) is convergent for all x lying 
outside (a, 5) to the value of the integral 


(2 (4.5 


ax 


When the interval (a, b) is infinite, the continued fraction (4.62) 
is not always convergent. The question of its convergence is related 
to the determination of the corresponding problem of moments. 

Regardless of the convergence, the continued fraction (4.62) is 
related to the integral (4.64) by the following property: the expansion 
of the convergent R,-1()/Py(®) of (4 62) as a series in negative po- 
wers of x coincides as far as terms of the order 1/x*®” (inclusive) with 
the series 

Bo | My 


x tx 





+34 eel +AaSt + ae ap euny (4.65) 
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which can be obtained if the function 1/(x—/) in the integral (4.63) 
is expanded as a series in powers of 1/x and formally integrated term 
by term (the convergence of series (4.65) is of no consequence). 

A continued fraction of the Chebyshev type, possessing the above 
property, is described as associated (assoziierte, Perron, ref. 11) with 
the series (4.65). 

In the case o(x) = const, the continued fraction (4.62) can be trans- 
formed, for x < 0, into a continued fraction of the Stieltjes type 


ae ek gl eee (4.66) 

Q4X4+ Ay -b agX+a,+... 
such that the mth convergent of (4.62) coincides with the 2nth conver- 
gent of (4.66). In view of this, the expansion as a series in negative 
powers of x of the 2nth convergent of the fraction (4.66) coincides 
with series (4.65) up to and including the terms 1/x?". A fraction 
of the Stieltjes type, possessing this property with respect to the series 
(4.65), is described as corresponding to it (correspondierende, Perron, 
ref. 11). We know from the theory of continued fractions that every 
continued fraction of the Stieltjes type (with a, #0) has a correspond- 
ing series, and every continued fraction of the Chebyshev type has 
an associated series. 

The converse problem is of great importance in analysis: transfor- 
mation of a previously assigned series in negative powers of x into a 
corresponding or associated continued fraction, yielding rational 
approximations for the function given by the series. 

Notevery previously assigned series has a corresponding or an asso- 
ciated continued fraction. A series possessing this property is described 
as seminormal. 

THEOREM 16. The series 


c 
x 
is seminormal if and only if all the determinants 


fag &1. fn 
a + grates hoa yt Ate 


Co Cy see Cn-1 Cy Co eee Cnm1 
oe PE Cc. c. es Cg... C, 
Pn = 1 2 n and Yn = 2 3 n 
Cn-1 Cn +++ Cong Cn-1 Cn +++ Con 3 


are non-zero. 
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In this case, the coefficients of continued fraction (4.66) corres- 
ponding to this series are expressed in terms of gy, and y,, as follows 


as —_ Pot 1Py—1 ee Pv+1P y 
a= Fy, 2, = -— a, Oy = 7 


PrPy Pr4i Pp . 


where gy = 1, y, = 1. 
The fraction (4.66) corresponding to the series can be transformed 
by a contraction (see Chapter V, § 1, sec. 3) into an associated fraction. 


5. The conversion of orthogonal expansions into a sequence of 
approximating fractions 


A problem can be posed similar to that of converting the series 
Co, 1, Cn 
wtoptst stant: 


into a continued fraction 


oe a ale 
QyX + Ay + agyX+ 0.5 
namely, conversion of the series 
R(x) = », C},0;(X), (4.67) 


where {w,(x)} is a system of functions orthogonal with respect to 
some weight in (a, 5), into a sequence of rational fractions of the form 


»-[$] 
Pals) By SK 
Gr(x) [=] 
& bio,(x) 


(4.68) 


Here, in analogy with the conversion of power series into continued 
fractions the numbers a, and b, are chosen so that the first n+ 1 terms 
of the expansion of the fraction (4.68) in an orthogonal system {w,(x)} 
coincide with the same terms in the series (4.67). The fraction (4.68) 
will also be termed in this case the n-th convergent. 
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The problem of finding such a convergent is not solvable in the 
general case. However, the problem has a solution for certain systems 
namely those satisfying the relationship 


Op (x)e4(x) = Ann 410%) + Byon(x) + Cy, -1(%). (4.69) 


Numerous orthogonal systems satisfy (4.69), including in particular 
all orthogonal systems of polynomials, the system of trigonometric 
functions {cos nx}, of Bessel functions {/,(x)}, and so on. 

The formal process of converting the series (4.67) into the fraction 
(4.68) can be accomplished for these systems as follows. The fraction 
(4.68) is sought as the mth convergent of a continued fraction of the 
form 

Sq (x) +O, D(X) +0 _ (x) + %5 . (4.70) 
1+ Box)+r+ ve +Bpo(x) +734 --- 


The requirement that the series (4.67) and the fraction (4.68) corres- 


pond can now be written as 


Py (x) — 9n(x) py CaO, (x) = An 41(X) + AS) Cn 4.9(X) +... (4.71) 


Comparison of the coefficients of like functions w(x), ..., @,(x) 
in (4.71) leads to the following expressions for the coefficients «,, B;, 
y, i =1,..., 2) of continued fraction (4.70): 


d252C,_ 
4=1, B=%1=0, w= B, Y, = oe 


app 
8, = Smet Bn aa t NPC + Pn” 
: a 
Oh, = ME Ca ai aa de-B, + a5 Any + Bd?) + yndg—9 - 
9 


da-v) 
(4.72) 
using these, we can find P(x) and q,(x) from the recurrence relations 


P(x) = &Pa—1(x) +[01(%) + BalPn—2(*) + YnPn—a(*), 


4.7 
dul2) = ey Gn() + 104(2) + Bald a2 + Pn a0D> x 3) 
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where we have put 


g2= 0 9g1=9% = ax)=1, 
P,~=0, Py=CQy, Py= Cy, P(x) = Cyo+ Co,(x) 


(bere, A,, B,, C,, are the coefficients of relationship (4.69)). 

To obtain rational approximations of sufficiently rapid convergence 
by this method, an effective approach is often to employ expansions 
in an orthogonal system of Chebyshev polynomials of the first kind 
(see § 4, sec. 7). 


6. Orthogonal polynomials and quadrature formulae of the 
Gaussian type 


The formula 


| ” $2) do(x) Arne) (4.74) 
3 =1 


for approximate evaluation of the definite integral is called a quad- 
rature formula of the Gaussian type if the base-points x‘ (i = 1, 
...) ”) and coefficients A\” (i = 1, 2, ..., ) are chosen so that 
(4.74) is accurate when f(x) is any polynomial of degree not exceed- 
ing 2n—1. 

THEOREM 17. If (4.74) is a quadrature formula of the Gaussian type, 
accurate for polynomials of degree not exceeding 2n—1, its base-points 


BO op a DM) 


are the n roots of the polynomial P,(x) of the system of polynomials 
orthogonal in (a, b) with respect to the weight o(x), while the coeffi- 
cients A\”) are the coefficients in the expansion of the n-th convergent 
Ry-1(x)[Px(x) of the continued fraction (4.62) into a sum of simple 
Jractions 

Rn-1(*) = 2 Ay 1 





P,(x) HS xxi’ 
Le. 
— ) 
Ao) = Raa) | (4.75) 


Py (xi) 
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Alternatively, (4.75) can be written as 


ayy =f? Pal dole) 
: a(t—x\)P,(t) 


In the particular case do(x) = dx and [a, 6] = [0, 1], (4-74) is 
the ordinary Gaussian quadrature formula, the base-points of which 
are the roots of the Legendre polynomial of degree n. 


7, The closure of an orthogonal system of polynomials 


The necessary and sufficient condition for closure of a system of 
polynomials {P,(x)}, orthogonal in (a, 5) with respect to the weight 
a(x) in the space L},,.(a, 5), is that the problem of moments for 
the sequence of moments of the weight a(x) be determinate or that 
a(x) be its extremal solution (see ref. 7). 

The problem of moments for a finite segment [a, 5] is always 
determinate, so that orthogonal systems of polynomials with respect 
to any weight on a finite segment are closed. In particular, the sys- 
tems of Legendre, Chebyshev and Jacobi polynomials are closed 
(see § 4). 

The problems of moments are determinate for the Laguerre weight 
(see § 4, sec. 9) on (0, +0), and for the Hermite weight (see § 4, 
sec. 4) on (— 9, + 9), i.e. these systems of polynomials are closed. 

Hence the Fourier series in orthogonal polynomials of a function 
f(x) of L2.,, are convergent in the mean to this function in the case 
of all the classical weights. 

A discussion of the convergence of series in orthogonal polynomials 
{P,(x)} at every point and of the uniform convergence requires 
asymptotic estimates of | P,(x)| as 2 + o. 


8. Christoffel’s formula. The convergence of Fourier series in 
orthogonal polynomials 


Let {P,(x)} be an orthonormal system of polynomials in (a, b) 
with respect to the weight o(x), and let f(x) be any function of the 
space L?,..(a, 6). 
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Let us write s, for the mth partial sum of the Fourier series of 
J(x) with respect to the system {P,(x)}: 


0) = S CaPr(. (4.76) 


If we make use of the expressions for the Fourier coefficients, 
S,(x) can be written as 


sie) = [s0(,3, AOAO ) doo, (4.77) 
The expression ‘i 
Kilt) = ¥ POPC (4.78) 


is called the kernel of the integral (4.77). The following formula holds 
for the kernel: 
Ky(t, x) = JInar Pras (t)P se — Pas iQ)P n(t) (4.79) 
x 
where A, ,, is given by (4.54). Formula (4.79), obtained by Christoffel 
for the casea = —1,b = +1, do(x) = dx, and generalized by Darboux 
to the case of any weight, is known as the Christoffel-Darboux 


JSormula, 
Formula (4.77) and the relationship 


i; K,(t, x) do(x) = 1 


lead to a formula for the remainder of the Fourier series of f(x) 
in the system {P,(x)}: 


Sx(x)—f(x) = eT x(t) Pnar(t)Pr(x) — Parl) P(t] do(e), 
(4.80) 
where 


pat) = LOL 


The next two theorems, on the convergence of the Fourier series 
of f(x), follow from (4.80). 
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THEOREM 18. If ail the polynomials P,(x) are bounded at the point 
x and the function ,{t) belongs to L3. (a, b), the Fourier series 


Y CoP a(x) 
k=o 
is convergent at x and 
fla) = Y CoPate). 


DEFINITION. The sequence of functions (x), $2(X), .- +5 Pn(x), 
... is Said to be uniformly bounded if there exists a constant M such 
that | 9,(x) |< M for all the functions of the system. 

THEOREM 19. Jf the polynomials P,(x) are uniformly bounded on 
(a, b), given any function f(x), integrable on (a, b) with respect to 
the weight o(x), its Fourier series in the system {P,(x)} is convergent 
to the value f(x) at every point x for which 


| ” pet) dort) 


exists. 

The following theorems establish the convergence of the Fourier 
series of f(x) in an orthogonal system of polynomials {P,(x)}, having 
regard to the structural properties of f(x) instead of the properties 
of the system. 

THEOREM 20. If f(x) satisfies the Lipschitz condition with index 
“>, 

2 
| fl) —f(xp | < M | x%2- > |*, 


then the Fourier series of f(x) in a system of orthogonal polynomials 
{P,,(x)} is convergent almost everywhere on (a, b). 


DEFINITION. The function L,(x) -| | K,(t, x)| do(t) is known 
a@ 


as the Lebesque function of the orthonormal system {P,(x)}. 
THEOREM 21. Let f(x) be continuous and let its best approximation 
by polynomials of degree n 


E,(f) = inf max |f(x)—Qa(x)| 
Qulee) (a, b) 
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satisfy the relationship 
Lr(%o) En(f) > 0 as n+ 


Then the Fourier series of f(x) in the orthogonal system {P,(x)} is 
convergent, at X = Xo, to the value f(x). 


§ 4. Classical systems of orthogonal polynomials 


1. Pearson’s differential equation 


The equation 


o Oo +a4x _ %(x) 
0” Bot Bxt Be (= 30) wan 


is known as Pearson’s equation. Solutions of the equation are called 
Pearson functions. The equation was introduced by Pearson for rep- 
resenting empirical laws of distribution. When «, = —1, a = 0, 


~1 x2 
8, = 1, 8, = 8 = 0, the solution is the classical function e ? 
— the density of a normal distribution law. 
The weights of all the most important systems of orthogonal poly- 
nomials are Pearson functions. 
Jacobi’s weight is 


o(x) = (1~ x)* (1+), (4.82) 


where 2 > —1, up > —1; (x) is defined on [—1, 1] and all its 
moments exist there. Pearson’s equation for Jacobi’s weight is 
(u—Aa)—(ut+A)x 


7 ——a—. (4.83) 


Chebyshey’s weight is a particular case of that of Jacobi, corres- 
1 


ponding toA= ->: b= “> 


a aq (4.84) 
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Pearson’s differential equation for Chebyshev’s weight is 


c x 
7 =>: (4.85) 


Legendre’s weight 0(x) ==1 is a particular case of that of Jacobi, 
corresponding to 2 =0, u = 0. Pearson’s equation for it is 
Q 1 


er (4.86) 








Any Pearson function, having all moments, and for which the 
denominator A(x) in (4.81) has real distinct roots, is reducible to any 
of the above functions by means of a linear change of the independ- 
ent variable. 

When the denominator f(x) has multiple or complex roots, the 
Pearson functions may not be weights of an orthogonal system of 
polynomials, since not all moments exist on the interval on which 
they are defined. 

The Chebyshev—Laguerre weight: 

o(x) = x*e-#*, where A> —1, u>0, (4.87) 
is defined on (0, + se). Pearson’s equation for the Chebyshev—Laguerre 
weight is 
A-p 

x 





x 


as 
7 (4.88) 
Any Pearson function, having all moments on (0, +), for which 
the denominator A(x) in (4.81) is a polynomial of the first degree 
(B, = 0), is reducible to this function by means of a linear change 
of the independent variable. 
The Chebyshev—Hermite weight: 


ox) = e™ (4.89) 
is defined on (— ©, +). Pearson’s equation becomes 

£ = 25. 

Q 


Any Pearson function, having all moments on (—~, +), for 


which B(x) = const. in (4.81) (8, = 8, = 0), is reducible to a Cheby- 
shev-Hermite function. 
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Thus all the Pearson functions that can serve as weights of an 
orthogonal system of polynomials are reducible to one of the above 
basic weights. 


2. The differential equations for corresponding classes of 
orthogonal polynomials 


The polynomials of orthogonal systems whose weights are Pearson 
functions satisfy linear differential equations of the second order, 
to which various physical problems often reduce — a fact that ensures 
their importance in applied mathematics. 

If the weight o(x) of an orthogonal system of polynomials satis- 
fies 
CO _ Xm t%X 

0 By t+B,x+ Bx?’ 


then the nth degree polynomial of this system satisfies the differen- 
tial equation 


B(x)y” + [a(x) + BOY’ — Yay = 0, (4.90) 


where y, = n[a,+(7+1),], and a(x), B(x) are as in (4.81). 
EXAMPLE 15, For Chebyshev’s weight, 


a(x) = x, a= 1, 
B(x) = 1-2», B= —1. 

The equation for Chebyshev polynomials is of the form 
(1—x?)y"— xy’ + ry = 0. 


3. The expression, by means of the weight, of a polynomial of the 
nth degree belonging to an orthogonal system of polynomials 


Let us consider an orthogonal polynomial system with Pearson’s 
weight o(x) from (4.81). Let P(x) be the mth degree polynomial of 
the system, orthogonal with respect to the weight function o(x). 
We can write P,(x) in the form 


Pa (3) = Anos Fo {OCB} (4.91) 
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The formula was obtained by Rodrigues for Legendre polynomials 
(in 1814), while similar formulae were later obtained for other poly- 
nomials. Rodrigues’ formula was first published in the general 
form (4.91) in ref. 5. 

If A, = 1, the coefficient of the highest term in P,(x) is 


an 
@= TT @+kh) (4.92) 
hken+1 
while for x"~1 it is 
Yr _ 2 rnp, 
bn = Gee, Nan. (4.93) 


The coefficient of the highest term in the normalized polynomial 


is 
as | a ee (4.94) 
nt o(x)B"(x) dx 


4. The generating function of an orthogonal system of 
polynomials with Pearson’s weight 


Let us take an orthogonal polynomial system {P,(x)}, where P,(x) 
is defined by (4.91) with constant 4, = 1. 

The generating function of the system is the function »(z, w) of two 
complex variables z and w such that 


y(z, w) = 5 ae w", (4.95) 


THEOREM 22. Given any orthogonal system of polynomials {P,(x)} 
with weight function 0(x), Satisfying condition (4.81), there exists a 
generating function (4.95), which is given by 


1 _ oéw) 
Q(z) 1—wB'(Ew) ’ 


where &,, is the root of the quadratic equation 
&—z—wB(é) = 0 (4.97) 


that is close to z for small w. 


y(z, w) = (4.96) 
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EXAMPLE 16. Let us find the generating function for the Legendre 
polynomials. 
Equation (4.97) becomes in this case 


wit E~(z+w) = 0, 
where 


Ey = = (-1441 + 4wz + 4w2) 


is chosen in such a way that €,, is close to z for small y, i.e. 


] 
a ae : 
ES at 1+./1+4wz +4) 


On applying formula (4.96) and putting o(x) = 1, we get 


1 


oe ese eta 4.98 
V1 +4wz + 4w? Co 


yz, ¥) = 


The derivatives of polynomials orthogonal with respect to Pearson’s 
weight are also orthogonal polynomials with respect to the weight 


= a(x) + B'(x) 
0,(x) = exp | 5 a ax| ‘ 


5. Legendre polynomials 


The first system of orthogonal polynomials was historically the 
system of polynomials with the weight function o(x) = 1 on [—1, 
+1], introduced by Legendre in 1785. 

We introduce the following notation: let L,(x) be the Legendre 
polynomial, in which we have not fixed the factor, to an accuracy 
of which the system of orthogonal polynomials is defined, let L,(*) 
be the mth degree polynomial with highest coefficient equal to 1, 
and let L(x) be the normalized Legendre polynomial. 

Rodrigues’ formula is 


Roe iin (4.99) 
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Formulae (4.92)-(4.94) lead to the pais for L(x) and L,(x:) 


Eu) = gay Ga PD (4.100) 


Lin = PS my Bt 1", (4.101) 


The explicit expression for a Legendre polynomial is 


k eS (2n — 2k)! 

(n—2k)T 
It follows from (4.102) that Z,(x) is an even function in x when n 
is even, and odd when n is odd. 


A recurrence formula. For the Legendre polynomials, we have 
in (4.54): 


[3 
L(x) = An bt (-1) Chix 2h, (4.102) 


oe _ _ (a+1)? 
Gry2 = 9, A= (n+1)Qn +3)’ 


= aah (n+l? = 
Lnso(x) = xLq41(x)— (n+ 1)Qn+3) L,(x). (4.103) 


Obviously, L(x) = 1, L(x) = x; we further obtain from (4.103): 
L@) = + Gx-0, 


T(x) = = (5x*— 32), 


L,(x) = x (35x4— 30x? +3), 


L,(x) = Ti 35 GIS 350x3+75x) and so on. 
The continued fraction (4.62) for a Legendre polynomial becomes 
14 8 (+1 
Bea 298 pt et ONL SOA 
x x x x x 


The denominator of the nth convergent of (4.104) is L, (x). 
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The continued fraction (4-104) is convergent to In(x+1)/(x—1) 
at every point x lying outside [—1, +1]. 

The generating function. Let H(x, w)be the generating function of 
the Legendre polynomials (4.95); (4.98) now gives 


1 


A(x, = ———_, 4.105 
mH) J1 ¢4wx +4? ¢ ) 
and 
a = § LO yn 
Jit4wx+42 n=o n! 
where 
2,(x) = S(t, 
or 


H(x, w) = 1—2xw + 2(3x2- Iw? — 4(5x3 — 3x) + 
+ 2(35x4 — 30x? + 3)wt+ 


The generating function of the Legendre polynomials is often 
written in the form 


A(x, t) = ens ae where t= —2w, 


J1—2xt+ 22” 


] oo 
————— = I, t*, 
J/1—2xt +12 2 n) 
where /,(x) is given by (4.99) with A, = 1/(2k)!!. 
The polynomials L,,(x) and L,(x) are expressed as follows in terms 
of 1,(x): 


so that 


a ! 
Li) = opr nes 


Lo) = JA t* 100. 


The polynomials /,(x) satisfy the recurrence formula 


(2+ 2)na2(2) = 2n43)xIn gx) — (2+ Dine). (4.107) 


(4.106) 
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The differential equation for Legendre polynomials is 
(1—x*)y" —2xy’+n(n + Dy = 0. 
The integral form of Legendre polynomials. The polynomial 


a 


ey oar + ea 1" 


can be written in the form 


1,(x) = i. (x +i 1—x? cos p)" dp (4.108) 


The integral in (4.108) is known as a Laplace integral (it has a real 
value for real x, in spite of the integrand being complex). The poly- 
nomials /,(x) are uniformly bounded on the segment of orthogonality 
[—1, +1). 

It follows from (4.108) that 


[1,(x)| = 1 (4.109) 
for 
[x{ sl. 


A stricter inequality holds for points lying inside the interval 


(-1, +1): 
n 1 
In(2)| Jz es (4.110) 


Turan’s inequality is 
Rx) = In-1 lng ®) =0 


forn21, -lsxsl. 
The following are expansions of certain functions in Legendre 
polynomials: 


1 
on, 
x™ = 5 ry 'of*) + 


2n(2n— 2)... (2n—2k +2) 


+ 2,0 Gy nana. Gada MO 
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xent+] = = 3G) + 
n 2n(2n — 2)... (Q2n—2k +2) 
+ ps (4k +3) Gu +3) (2n+5). : . (2n+2k +3) lon+1(X)s 
as ‘Ore 2 
bg =% Faery {A en, tet 
x (2k—1)!1!(2k+1)!! oo 
"5: dy, Gk+ ) eat hreiX), |x] <1. 
os N(k—1)!1 
virB =${5 — 5 Saree ae} 
|x| <1, 


© =—11t\2 
wresinx = FF (Spr) Canes Izl= 1 
The convergence of Fourier series in Legendre polynomials. 
THEOREM 23. If f(x) has a continuous second derivative in [—1, +1], 
it can be expanded as a uniformly convergent series in Legendre poly- 
nomials in [—1, +1]. 
By (4.106) and (4-109), we have the following inequality for nor- 
malized Legendre polynomials: 


Le < PE for |x| 1. (4.111) 


Formula (4.111) and the corresponding inequality for the kernel 


K,(t, x) of L(x) give an inequality for the Lebesgue function (see 
§ 3, sec. 8): 





L,(x) S (n+ 1). (4.112) 
A consequence of Theorem 21 (see § 3, sec. 8) and (4.112) is: 
THEOREM 24, Every continuous function f(x), the best approximation 
of which satisfies the condition 


lim rE,(f) = 0 (4.113) 


can be expanded as a uniformly convergent series in [—1, +1] in 
Legendre polynomials. 

The following is a consequence of Theorem 23 and formulae (4.106) 
and (4.110): 
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THEOREM 25. A function f(x), the square of which is integrable in 
[-—1, 1], can be expanded as a Fourier series in Legendre polynomials 
convergent to f(x) at every point x for which the integral exists: 


f (eye. fang 
-1 


x 

Remark. Condition (4.114) is satisfied, in particular, if the finite 
derivative f’(x) exists at the point x. 

THEOREM 26. Let f(x) be a function, the square of which is integrable 
in [—1, 1], and suppose the left- and right-hand limits f(x—0) and 
S(x—0) exist at the point x In this case, if the integrals 


f (On ee .(2 i p 
t—x ‘6 t—x 


-1 
are finite, the Fourier series in Legendre polynomials is convergent 
at the point x to [f(x—-0)+f(x+0)] 
THEOREM 27. If f(x) satisfies the Dini-Lipschitz condition in [—1, 
+1): 
lim (6) In (6) = 0 
é—>0 


(where w(6)= sup {{f(x,)—Cf(*.)|} is the oscillation of 
[x—xe| <3 

S(x)), it can be expanded at every point of the interval as a Fourier 

series in Legendre polynomials, the convergence being uniform in every 


segment [—1+h, 1—A] (h>0). 


6. Jacobi polynomials 


The Jacobi polynomials are polynomials orthogonal in [—1, +1] 
with respect to the weight 


a(x) = (1-xP(L+x)*, (4.115) 


where A> —1, w>—1. The weight function (4.115) is Pearson’s 
weight (see § 4, sec. 1). The above definition specifies the Jacobi 
polynomials apart from a constant factor. If this factor is not fixed, 
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we shall denote the polynomials by J "(x); we write J@”)(x) 
if the coefficient of x” is unity, and ice (x) if the polynomial ‘is 
normalized. 

The Legendre polynomials (see sec. 5) are a particular case of 


Jacobi polynomials, with A= y=0. The case 4=p= Sand 
A=y"= -> are specially treated later (see sec. 7, 8). The poly- 


nomials corresponding to these values of 2 and yu are called Chebyshev 
polynomials (of the second and first kind respectively). 

In general, the case A = yw has certain special features. The Jacobi 
polynomials with 1 = yu are said to be ultraspherical. 

Rodrigues’ formula. Formula (4.91) gives for Jacobi polynomials: 


in 
J (x) = A,(1+x)7" il [(1—x)+"(14+x)#*"], (4.116) 


where we have for J‘ ")(x): 


= Pa+tm+nt+) 
A, = eal corEnTE rea yy. 4.117) 


and for J*#x): 


yn es g-Gtutonsenl Ate tne DT A+e+ 20+ 1) 
7 LPA+n4+)DPQ@t+n+n! 
(4.118) 
These formulae are suitable for nm > 0. They are also true for n = 0, 


provided A+u+1 +0; if A+u+1=0, they lose their meaning 
at n = 0, though it is clear that 


JH (x) = 1. 


An explicit expression. If A,, = (—1)"/2"! in Rodrigues’ formula 
(4.116), we shall write j"(x) for the corresponding Jacobi poly- 
nomial. It is often convenient to discuss this Jacobi polynomial. 
For it, the following formula holds: 


FO) = 
— 1 &., PA+nt)F@int) = ask k 
= wal & Tan kt DTG aeaD OW Pat. 
(4.119) 
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A recurrence relation. The general recurrence relation (4.54) for three 
consecutive polynomials of a system of orthogonal polynomials 
becomes, in the case of the system of Jacobi polynomials; 


SRL BX) = (on 42) P(X) — Ang I R), (4.120) 


where 
pe — 92 
“nea put n+ tet m+) ’ 
ee (Atnt+1])(ut+n+lIA+putn+l) 4(n +1) 
+1 At pt antl Ate +2042? A+ +2043) : 
(4.121) 
Since 
= = A-p 
(A, a) = Gio 
JeeM a1 and JY =x ENT Ea 


all the Jacobi polynomials can be obtained successively from (4.120). 
These expressions are very unwieldy, however; e.g. 


S A—u A—wP+d+py)—4 
{ho (x) = x? +22. x + 2 
JS M(x) = x eT eager (A+u+3)A+u+4) 


and so on. The explicit formula (4.119) is more practical for their 
actual computation. Complete tables of Jacobi polynomials are 
available (see ref. 3). The Jacobi polynomials satisfy recurrence rela- 
tions, not only with respect to the parameter z, but also with respect 
to the parameters 4 and n, A, uw and n, these being consequences of 
Gauss’s formulae for the hypergeometric functions; the Jacobi 
polynomials are a particular case of the latter. 

The generating function. Let /(x, w) be the generating function of 
the Jacobi polynomials (see sec. 4). Formula (4.96) now gives 


Qatu —————-—, _4 
I(x, w) = —————— _ (1+2w + J/14+ 40x +4? x 
oy ew roger a ie 
x (1—2w+./14+4wx+4w2)-* = (4.122) 
and 


I(x, w) = y Ja) yn 


nap! 


(4.123) 
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where 


JO we) = (1—x)-*(14x)- aa “(a- x) (14-x)8t"], (4.124) 


The generating function for the Jacobi polynomials is often 
written in the form 
7 (1- 14. VIF )* 

sa (1-1 + V1 -2xt + 7) X 
J1—2xt+2 
x(1424+J1—2xt+ #2), (4.125) 

where t = —2w; the coefficients of the expansion in powers of t 
are now the polynomials jx) (see (4-119)). In the case of ultra- 
spherical polynomials (A = y), the generating function is simplified 
if we introduce, instead of polynomials j?:"(x), the polynomials 


Ix, th = 


r (« +h) rt20 
y(x) 


je*Mx), where «= ip : 
in fact, 
(12x02 =F yOOoer, (4.126) 
n=O 


By using the ultraspherical polynomials y*, N. Ya. Sonin obtained 
an analogue of Taylor’s formula: 


fix+a) = 2TQ) » (n+ ») ee) us _ 


SSX), (4.127) 


where J,(«) is Bessel’s function, D = d/dx. 

A differential equation for Jacobi polynomials. Differential equation 
(4.90) for polynomials orthogonal with respect to Pearson’s weight 
function, becomes, in the case of Jacobi polynomials: 


(1— x)y" + [(u— a) —(H+A42)x]y’+nAtptn+Dy = 0. (4.128) 


Inequalities for Jacobi polynomials and the convergence of the 


Fourier series. Given the condition 
1 


o = max {A, w} = => (4.129) 


the following theorems hold. 
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THEOREM 28. The greatest value of the modulus of J )(x) is 
attained in the segment [—1, 1] at one of the points x = +1. 

THEOREM 29. Given condition (4.129), the normalized Jacobi poly- 
nomials satisfy the relationship 


* ott 
[J (x)|< Mn ? 
for all |x| #1. 
Here M is a constant, depending on A and wu. 
It follows from Theorem 29 that the Lebesgue function of the 
Jacobi polynomials satisfies 


Ly(x) < Myn?e*?, 
which leads, in conjunction with Theorem 21 (see § 3), to 
THEOREM 30. Let o = s and let p be a positive integer not 


less than 20+2. Every function f(x), defined in [—1, 1] and having 
a continuous derivative of order p, can be expanded as a unifornily 


convergent Fourier series in the polynomials J (x). 


7. Chebyshev polynomials of the first kind 


Chebyshev polynomials of the first kind are a particular case of 

Jacobi polynomials (see § 4, sec. 6), corresponding to 4 = p = -> 
eed cel 

The polynomials sh 2-2) were first discussed by P.L. Cheby- 

shev in 1857, when solving the problem of the best approximation 

of continuous functions by polynomials. We shall denote them by 

T,(x); these polynomials were obtained by Chebyshev in the form 


T,(X) = Cos (n arc cos x). (4.130) 


Formula (4.130) defines 7,(x) only on the segment [—1, 1]. But 
definition (4.130) can be extended to all values of x by means of the 
familiar trigonometric formula. 

cos np = cos" p— C2 cos"“? » sin? p+ C3 cos"-4 p sint p— ... 


(this completion of definition (4.130) will be assumed without making 
any special proviso in future). 
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The polynomials 7,,(x) possess many remarkable so-called extremal 
properties in addition to their general properties as polynomials of 
an orthogonal system; these extremal properties will be described 
after dealing with the general properties. 

Rodrigues’ formula is 


d” 1 ig 
T,,(x) = A, vi-8 (753) . (4.131) 


We shall write 7,(x) for the polynomial with highest coefficient 
equal to unity, and T,,(x) for the normalized polynomial. 

An explicit expression. Formula (4.130) yields an explicit expression 
for the Chebyshev polynomials, where 


T,(x) = ai cos (marc cos x), 
5 (4.132) 
T,(x) = iz cos (marc cos x). 
Expression (4.130) can also be written in the form 
| 
T(x) = > [(x+ Vx?= 1)" + (x Yx?= 17") 
oF (4.133) 


n 
2 n 
= — 1k 2 Ch on—2h-1yn-2k 
T(x) = (= 1h Sy CR Dita, 
As follows from (4.130), the zeros of T(x) are the numbers 


xin) = cos E-De (k=1,2,...,”) (4.134) 


The recurrence formulae 


Ty (x) = 2xT,_1(*%) — Tn-2), (4.135) 
Fy(2) = aT) Tao) (4.136) 


follow from (4.120) with A=u= > Since T,(x) = 1, 7,(x) = x, 
it follows from the equation (4.135) that 
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T, (x) = 2x?-1, 

T3( x) = 4x°- 3x, 

T,( x) = 8x*— 8x? +1, 

T; (x) = 16x5 — 20x? + 5x, 

T, (x) = 32x8 — 48x4 + 18x?4+ 1 
and so on. 


In the case of Chebyshev polynomials, the continued fraction 
(4.62) becomes 





de oe a 
x 4 4 4 
Boe Seo C0 
since here, 
1,=2= as Met. gle 
: Vine” “79? ' 


The denominator of the mth convergent of the continued fraction 
(4.137) is T(x). The continued fraction is convergent, for all x 


outside the interval (—1, 1), to the function n/Vx?—1, 
The generating function. The coefficient of t” in the expansion of 





T(x, t) = ee (4.138) 
in powers of ¢ is the polynomial 7,,(x): 
T(x, t) = —— = TM) 4+2 ¥ T(x. 
—2tx+t nel 
The differential equation for Chebyshev polynomials is 
(1—x*)y”— xy’ +rPy = 0. (4.139) 


Expansion of a function as a Fourier series in Chebyshev polynomials 
and the comparison of this with the expansion as a Maclaurin series. 
Wide use is made of Fourier series in Chebyshev polynomials 7,(x) 
for uniform approximation of functions. Notice that the expansion 
of a function f(x) in [—1, 1] as a Fourier series in polynomials T,,(x) 
reduces to the expansion of f(cos x) in [—z, 2] as a Fourier series 
in cosines. 
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For instance, 


er08 @ — J (a)4+2 x I, (a) cos ng, 
n=l 


where J,(a) is Bessel’s function; hence the substitution x = cos 
gives 


= I,(a)+2 y I,(a)T p(X). 


An expansion may similarly be obtained for f(x) = x" from the 
familiar trigonometric formulae: 


n-1 
cos2” p= al x 2Ce cos 2(n—k)p+ ch) ’ 


cos?*-1y = a. Sai Ck,~1 Cos (2n — 2k — 1)p. 


The substitution x = cos gives 


xen = m(2 > 2ChnTon—2n (x) + ch). | 


; | (4.140) 


pan=2 = Ch, -1Tan—2h-1(2)- 


xean-1 





Similarly, expansions in Chebyshev polynomials T, n(x) follow from 
the expansions in cosines (with |x| < 1): 


2 4 Tn (x) 





jn} =S4e eS, (4.141) 
sign x -23C 1yr42 Tana) (4.142) 


cos ax = Jo(a)-+2 5 (—1)"Jon(@)Tan (x), (4143) 
nel 
sin ax = 2 3) (—1)"*Vgn—1(@)Tan—1 (2); (4.144) 
nel 


: 42 Ton—1(X) 
pena — ][yrt1lenci "2 
aresin x = > on! 1)" n=1?’ (4.145) 
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e* = I(a)+2 ¥ In(@)Tr(), (4.146) 
n=l 


in(l—2x+q)=-2F OT) (\gi<d. G47 


In general, if C, is the Fourier coefficient of f(cos x) in the system 
{cos ny}, we have 





CC, = ae S(cos ¢) cos np dp = =| LOT (x) . (4.148). 


7 
Roughly speaking, when such icine are represented by the sum 
of a like number of terms, the limits of the accuracy are 2"~1 times 
better for an expansion in Chebyshev polynomials than for a Taylor 
series. 
For example, when |x| = 1 follows from (4.146) that, in the case 
of f(x) = e™ with large 7, 
gnt32 q™ 
Cae ella) 2| stat Ga lylaret | ~ ager? 
while at the same time 
f Oy. at 


n!} ni- 





If we substitute the Maclaurin series for f(x) 


” (n), 
fa) = 0) +/' Ox +O wt. Oa, 
under the integral sign in (4.148), in view of the orthogonality of 
the polynomials 7,(x) and the expressions (4.138), (4.140), we get 
an interesting connection between the coefficient C,, in the expansion 
of f(x) in Chebyshev polynomials and the corresponding coefficient 
of Maclaurin’s formula for f(x), viz 


1 (FO, f£%+20) fr+an0) 
n= 3 >( nm ‘Gao Gea ee) 
It follows from (4.149) that, if-the principal part of f™(0)/n! +...) 
reduces to f‘"(0)/m! for large n, we have 
1 SMO) 


Cr 
n n} 








(4.150) 
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It follows from (4.150) that, given |x] < > the expansion of a 
function as a Maclaurin series is in general better, whereas the expan- 


sion in Chebyshev polynomials is better for >< |x| < 1, since 


max | C,7,(x)| = Cp < max oe: 
$<ixigi! 





rai 


The convergence of Fourier series in Chebyshev polynomials. In view 
of the fact that 
17, @)| = 1, 


it follows from Theorem 19 § 3 that: 

THEOREM 31. Given any function f(x), integrable in (—1, 1) with 
respect to the weight \/./1—x?, its Fourier series in the system {T,(x)} 
is convergent to the value f(x) at every point x for which the integral 


fxy-f() __ at 
-1 x-t J1l-# 
exists. The Lebesgue function of the system of Chebyshev polyno- 
mials satisfies the inequality 


L(x) S 2+1nn. 


We therefore have (see Theorem 23 § 3): 
THEOREM 32. Every function f(x) for which 


lim £,(f) Inn = 0, 
N—poo 


.can be expanded as a uniformly convergent series in Chebyshev poly- 
nomials, 

The extremal properties of Chebyshev polynomials. 

THEOREM 33 (Chebyshev). Of all the polynomials with highest 
coefficient equal to unity, the polynomial T. w(x) has the least deviation 
Srom zero, i.e. 


max |7,(x)|< max |Q,(x)| 
1 -lixS1 


-1S2*s 


Sor ail polynomials Q(x) of degree n, having highest coefficient equal 
to unity. 
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COROLLARY. Since 
1 


max |7a@)| = pn? 


-lix= 


we have for any polynomial Q,,(x) with highest coefficient equal to unity: 


1 
max | Q,(x) | > pn=1 . 
1 


-1Sc= 


The following interpolation property of the zeros of a Chebyshev 
polynomial is a consequence of the theorem. Suppose we form, with 
respect to the points x,, %,, ..., x, an interpolation polynomial 
Q,-,(x) of degree n—1 for a function f(x), n times differentiable 
in [—1, 1]. The remainder term of the accurate interpolation is 
now given by 


(n) 
Ry(2) = $0)— Qua) =A (x) Om). ms 
where 
%i< M4, and F€ (x1, Xn). 


If the interpolation base-points x,, X,, ...,X, are zeros of the Cheby- 
shev polynomial 7,(x), then 


max |(x—x,)(x—%,)...(x*—Xp)| 
x€(—1,1] 


has a minimum value. 

Thus, if the coefficient of f((&) in (4.148) changes only a little in 
relation to the variation of x in (—1, 1), the interpolation base-points 
which are roots of the polynomial 7,,(x), yield the least value of the 
remainder term. 

THEOREM 34 (Chebyshev). Of all the polynomials Q,(x), subject to 
the condition Q,(£) = M, where |&| < 1, the polynomial MT,(x)/T,(&) 
deviates the least from zero in the segment [—1, 1]. 

THEOREM 35 (A. A. Markov and V. A. Markov). Jf the polynomial 
Q,(x) satisfies, in [—1, 1], the inequality 


10,(x)| = M, 
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the derivative of order k of this polyomial satisfies in [—1, 1] the 
inequality 
n(n? —1)... [n? —(k—1)?] 


|OMC)| = M——33— oR) 


(4.151) 


the sign of equality being obtained in (4.151) only for the polynomial 
T,(x) at the points x = +1. 


8. Chebyshev polynomials of the second kind 


The polynomials of the second kind with respect to the weight 


1/V1— x? (see § 3, sec. 4), i.e. the numerators of the convergents of 
the continued fraction (4.137), form an orthogonal system in [—1, 


1] with respect to the weight o(x) = /1—x? and are therefore the 


Jacobi polynomials corresponding to A= wp = > They are known 


as Chebyshev polynomials of the second kind. We shall denote them 
by U,,(x). : 

The Chebyshev polynomials U,(x) and T,,,(x) are connected 
by the relationship 


Un(x) = Cp £ Tn41(X)- (4.152) 


An explicit expression for the polynomials. We have from (4.152): 


sin [(n+ 1) arccos x] 


Jl—x? 


Formula (4.153) defines U,(x) only in the interval (—1, 1), but this 
definition may be extended to all x by means of the familiar trigono- 
metric identity 


U,(x) = Cp (4.153) 


sin(n +1)p = sin"*+1 p— C2,, sin"-1 pcos? p+ 
+C4,,sin"-3 p cost g— .... 


In U, (x), let the coefficient of x” be unity, while || Ua = 1. 
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Now, 
= 1 sin [(n+1) arccos x] 
U, eS > . 
a) => ina (4.154) 
- 2. sin [((1+ 1) arccos x] 
U,(%) = ./-—- ———_—_— .. 
Oa <i ore 


Recurrence formula. As the numerators of continued fraction (4.137), 
the polynomials U,,(x) satisfy the same recurrence relation as T,, , ,(x): 


Una2(x) = xD as)—> T(x), 


where U(x) = 1, U;,(x) = x; hence 


= 1 
Tx) = #8-F, 
1 


U,(x) = B->%, 


= 3 1 
U,) = x8— 7m +7 and so on. 

A continued fraction for polynomials U,(x). These polynomials 
form an orthogonal system with respect to the weight o(x) = V1—x? 
and are in turn the denominators of the nth convergent of the conti- 
nued fraction 





Fee Rs (4.156) 
where 


natal Jae, while haa G = 1, 2, - ++). 


The numerators of the mth convergents of the continued fraction (4.156) 


are U,,-\(*)- For all x lying outside the segment [—1, +1], the con- 
tinued fraction is convergent to the function 


S() = (x= Vx? =1)a. 
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Fourier series in Chebyshev polynomials U,(x). The following 
inequalities hold: 


\0,01< [2Foan (-1sxs 1), 
; es ; (4.157) 
OER a Chee, 

The next theorems are consequences of (4.157) and the general 
theorems (see § 3, sec. 5). 

THEOREM 36. Every function, having a continuous derivative of the 
third order, can be expanded as a uniformly convergent series in poly- 
nomials U,(x). 

THEOREM 37, Every function f(x) of Ljy=g(—1,1) can be expanded 
as a Fourier series in the orthogonal polynomials U,(x) at every point 
x, and for every f(x) the following integral exists: 


| ; (229) Jizhat. (4.158) 


~-1 x—-t 


THEOREM 38. If a function f(x), defined on [—1, 1], satisfies the 
Dini-Lipschitz condition 


lim (6) In 6 = 0, (4.159) 
é—>0 : 


it can be expanded in the interval (—1, 1) as a Fourier series in poly- 
nomials U,(x), the convergence being uniform in any interval (—1+ 
+h, 1—A). 

Given suitable convergence conditions, (4.152) enables us to diffe- 
rentiate the expansion 


fe) = ¥ anTn(2) (4.160) 


term by term, to obtain the expansion 


eo 


f(x) = YY na,Un—1@). 


n=} 
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Expansions (4.139 —4.142) given above in polynomials T,, lead to 
the following expansions in polynomials U,: 


= < x nI,(a)U,_(x), 
nel 


3 2nUgn_1(x) 
n=l 4r?—1 : 








sd 
% 
P 2 
sin ax = — Yi (— 1)" 2nJon(a)Van—a(%), 
ea 
a 


. (= 184? (n= I)Jon-1(2)Ugn—1)(*) 


and so on. 


An extremal property of polynomials U,(x). 


THEOREM 39 (Chebyshev). Of all the polynomials Q,(x) of degree 
n with highest coefficient equal to unity, the least value of the integral 


f. |On(x) | dx 
-1 


is given by Q,(x) = U,(x)- 


9, Laguerre polynomials 


The polynomials orthogonal in the interval (0, +) with respect 
to the weight function e(x) = x*e~* (« > —1) are usually called 
Laguerre or Chebyshev—Laguerre polynomials. 


These polynomials were first encountered in the case « = 0 in 
the analytical mechanics of Lagrange, then in Abel’s posthumous 
papers. Chebyshev discussed the polynomials in 1859, and for them 
obtained a recurrence formula and an expansion as a continued 
fraction; it was only in 1878 that they were considered by Laguerre. 
The case of any « > —1 was first discussed by Sokhotskii. 

Some authors only speak of Laguerre polynomials in the case 
« =0, and refer to generalized Laguerre polynomials when « = 0. 
We shall denote the latter by L(x). 
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Rodrigues’ formula is 


L(x) = Anx*e* < (x*%e-*) (4.161) 


The polynomial L(x) with highest coefficient equal to unity is 
obtained from (4.161) with A, =(—1)", while the normalized 


L(x) is obtained with 
= (-1)" 
i JalT(a+n+1)- 


A recurrence formula: 
T(x) = (x—a—2n—3) Lt, ,()—(n +1) (ntat1) Lax). (4.162) 
In the case « = 0 this reduces to 
Laaa(x) = (x—2n— 3) Lags(x)—(n + 1? £,@), 
from which we find, using L,(x) =; L(x) =x-l, 
L,(x) = x°—4x+2, 
T,(x) = 8—9x?418x—6, and so on. 


A continued fraction for polynomials L(x). In the case 2 = 0, the 
continued fraction (4.162), of which the denominator of the nth 
convergent is L,(x), takes the form 


bd (4.163) 


x—-1l—x-3-—x-5—x-7T-.... 


The continued fraction (4.163) is convergent for all x not lying in 
(0, +) to the function 


S@ = I, say tt 


The continued fraction for any «, 


I(a+ atl 2(a + 2) 3(a +3) 7 
x—(«+1)—x—(@ +3) — x-—(«@ +5) —x-—(@ +7) (4.164) 


is convergent for any x not lying in (0, +), to the function 


fa) = | ge ily 
0 





x—t 
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A differential equation for L*(x): 


xy" +(«@+1—x)y’+ny = 0. (4.165) 


Sokhotskii obtained a formula for the power x” in terms of Laguerre 
polynomials: 


Li—n(*) 
= I(nt+a+l) os »ln—k+a41) ‘ 
The generating function is 
t 
(1—1)-*-1e it =e 9 SS (4.166) 


n=O 
Formula (4.166) was first obtained by Sokhotskii. The generating 
function can also be written in the form 
L(2iJftx) L(x)" 
(iftx)® = neo n! (a +n+1) : 
where J,(z) is Bessel’s function. Formula (4.167) was obtained by 
N.Ya. Sonin. Sonin also obtained the relationships 


po(t, x) = em! (4.167) 








1 dLSas(x) _ Ee), 
n(n-+a)L@ (x) _ d 4 (i (4.168) 
e: eedie man an 
x 


Closure of the system {L°(x)}. The problem of moments for the 
sequence 


Ln = | e7txtn dx 
0 


is determinate, from which it follows, by Riesz’s Theorem, (see § 3, 
sec, 7) that the system {L‘(x)} is closed in the space L? pole (0, +). 


The Laguerre polynomials can be obtained from the Jacobi poly- 
nomials j*") by means of a passage to the limit: 


L(x) = lim jf (1 -2) (4.169) 
b> co 
(K. A. Posset’s formula). 
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10. Hermite polynomials 


The polynomials, orthogonal on (— ~, +o) with respect to the 


1 
weight o(x) =e ? - are known as Hermite polynomials. This 
name is sometimes given to the polynomials orthogonal with respect 
to the weight e~**. Such polynomials are first encountered in Lap- 
lace’s works, then in those of Chebyshev (1859). Chebyshev obtained 
a Rodrigues’ formula and an expansion as a continued fraction. 
They were considered by Hermite five years after Chebyshev. Ro- 
drigues’ formula is 


xf gn ( = 
H,(x) = Aye? &(e2), (4.170) 


when A,, = (—1)” we get H,(x) — the polynomial with highest coef- 
ficient equal to unity; when 4, = (—1)"/ Vn! J2n we get the normal- 
ized H,(x). 

The recurrence formula is 


Fay al) = xH,(x)—nH,_,(x); (4.171) 
since H(x) = 1, H,(x) = x, we get 
H,(x) = *-1, 
H,(x) = x8 — 3x, 
H,(x) = x*— 6x2 +3, 
(x) = x5—10x°+15x, and so on. 
The generating function is 


5 F Ane 


n=O n! 


(4.172) 


The continued fraction (4.62), of which the denominator of the 
nth convergent is the polynomial H,,(x), is 
vin 


1 2 3 
ogg Seeks Ga) 
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Fraction (4.173) is convergent for all non-real x to the function 


| ee dt. 
noo X—t 


A differential equation for the Hermite polynomials: 
y’—xy’tny = 0. (4.174) 





The polynomials H,(x) can also be obtained from the Jacobi 
ji Mx) as A+ oo: 


polynomials j\, 
H,(x) { -2, - 
aa = lim [? 370 a) (&)| . (4.175) 


Closure of the system of Hermite polynomials. The problem of mo- 
ments for the sequence 


oe zt 
Ln = x"e 2dx 
is determinate. Hence it follows by Riesz’s theorem (see § 3, sec. 7) 
that the system {H,(x)} is closed in the space oe ies (—, +), 


11. Chebyshev polynomials, orthogonal on a finite 
system of points 


In a paper of 1855, “Continuous fractions” (O nepreryvnykh 
drobyakh), and in certain other works, Chebyshev considered the 
expansion of the sum 

y 67(x;) 


6%(x;) = m 
41, 7z7—-%,’ (x;) 4 


as a continued fraction and investigated the properties of the denomin- 
ators of its convergents. 

If o(x) is a step function with growth points x), x2, ..., xy, the jumps 
at which are equal to m,, mg, ..., My respectively, then 


N 62(x;,) a t do(x) (4.176) 


41 2-% a 
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The denominators of the convergents of the continued fraction (of 
type (4.62)), corresponding to integral (4.176), are now polynomials 
orthogonal with respect to the weight function o(x). 

The orthogonality of P,(x) and P,(x) with respect to o(x) implies 
in this case that 


SORIA =0 Hk, 


The continued fraction (4.62) is now finite, the system of orthogonal 
polynomials is also finite and contains precisely N polynomials Po(x), 
P,(x), ...» Py_, (x). Chebyshev applied the results of his investiga- 
tions to interpolation by the method of least squares which consists 
of the following. The values of the function f(x) are specified at the 
points x,, X2, ..., Xy.- Among all the polynomials of a given degree 
n < N, we have to find the polynomial @Q,(x) such that the sum 


¥ Me) G00? (4.177 


is a minimum (see § 1, sec. 3). 
Let 6°(x,) = 1 in (4.176); then 


N 0 
& [fxi)— Qn )P = (f(x) — Qn(x))? do(x). 

And, as follows from § 2, sec. 4, (4.177) takes its least value when 

Q,(x) is the nth segment of the Fourier series of f(x) in a system of 

polynomials orthogonal with respect to the weight function o(x). 

Using a system of equidistant base points on the segment (0, 1]: 


MEH (i= 1, 2,...,N). 


Chebyshev formed an orthogonal system of polynomials {6(x;)? = 1}. 
These are also known as Chebyshev polynomials. We shall denote 
them by P, n(x) (the polynomial of degree k in the system {x; = 


Pp, w(x) = 1+4+4,x + Ggx(x— 1) +.4,x(x— 1) (x-2) +... 
eae $apx(x—1)...(4-k +1), 
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where 
ec (—1)°ChCha1 ; 
5 n(n—1)...(n—st+) 


In particular, 


Po, n(x) = 1, 
x 
P,, n(x) = 1-2), 
by x x(x—1) 
Po, n(x) = 1-655 +6 FN) ; 


x(x- 1) 2 x(x—- 1) (x—2) 


x 
Ps, n(x) = be =D NN—1)(N=2)’ 


_ x x(x—- 1) 
Py, n(x) = 1 20 +90 





NMV-D 
1 x(x— 1) (x—2) x(x— 1) (x—2)(x—3) 
—EN(N=1)(N—2) + | NWW—1)(N—2) (V—3)’ 
Ps, n(x) = 1 — 30 -+210 a s a 
x(x — 1) (x—2) x(x— 1) (x—2) (x—3) 
— 500 TiN) (N—2 + NW) WED (N=) 


959 2@—DO-DE-I(x~-4 
N(N—1)(N—2)(N—3)(N—4)’ 


and so on. The interpolation polynomial of degree m with respect 
to the system base points {x; = i/N} for f(x), defined by the method 
of least squares, is the segment of the Fourier series of f(x) of order 
m with respect to the system {P, (x)}: 


On(x) = ¥ CoP, wd, 
where 


Gites | * fdPa, n@) dos) = ¥ MdPa,w(0. 
fe) om, 
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The expression for C, does not depend on the degree of interpo- 
lation m. On increasing the degree of the interpolation polynomial 
new terms are simply added: 


Omsi(X) = Onl) + Cr4iPmi4i, w(x) - 


Chebyshev showed that the case when o(x) is continuous can be 
obtained by means of a passage to the limit from the case when 
o(x) has a finite number of growth points. 

In particular, the Legendre polynomials can be obtained from the 
polynomials P, (x) as N ~ oo. If L,(x) is a Legendre polynomial, 
normalized by the condition that L,(1) = 1, we have 


L,(2x—1) = aor im lim | | (oa Oey ae Fs 


CHAPTER V 


CONTINUED FRACTIONS 


Introduction 


1. Notation for continued fractions. Basic definitions 


An expression of the form 


is called a continued fraction. 
In view of the unwieldiness of the above method of writing, several 
authors have proposed different methods, for instance: 





a,| . a| Ap | is : 
ba +——+..., Pringsheim 
oN Tb ae ae aa 
aes Nope: eet id, : (Miller) 

by by n 

a on: 


(Rogers) (5.1) 


We shall use the last notation. Pringsheim also proposed writing a 
continued fraction in the form [b9; a,/b,]>. If a,, and b, in frac- 
tion (5.1) follow a different law to the remaining a, and b,,, Pringsheim 
used the notation [b9; a,/b,, a,/b,)>. 

The fraction a,/b, is called the n-th partial quotient of the continued 
fraction (5.1); a, and 5, are the terms of the n-th partial quotient; 
@, Ag, a3,... are called the partial numerators of the continued 
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fraction; b,, b., bs ,... are its partial denominators; b, is called the 
zero partial quotient. , 

All the terms of the partial quotients will be assumed finite; all 
the partial denominators are usually assumed to be non-zero. 

A continued fraction having a finite set of partial quotients is 
described as terminating. 

A continued fraction having an infinite set of partial quotients 
is described as non-terminating. 


2. A brief historical note . 


Algorithms similar to continued fractions were employed even by the mathe- 
maticians of antiquity (Euclid’s algorithm, the Archimedean approximation to J3). 
Of the médiaeval mathematicians, Omar Khayyam (c. 1040-1123) came close 
to continued fractions when trying to generalize Euclid’s algorithm to the case 
of incommensurable magnitudes, but continued fractions as such first appeared 
in the “Algebra” of the Italian mathematician R.Bombelli, published in 1572. 
A number of outstanding mathematicians of the seventeenth century, including 
J. Wallis and Chr. Huygens, occupied themselves with continued fractions, but 
the founder of the theory of continued fractions as an independent branch of 
mathematics was Euler. Almost all the great mathematicians of the eighteenth 
century and the first half of the nineteenth century made some contribution to 
the development of the theory. Interest has recently returned afresh to continued 
fractions, owing to their great theoretical and practical value. In particular, con- 
tinued fractions are employed in various approximate computations. For instance, 
with their aid we can compute approximately the values of many functions, the 
power series expansion of which are slowly convergent or even divergent. 


§ 1. Continued fractions and their fundamental properties 


1. The evaluation of convergents. Convergents 


The terminating continued fraction 
a 4, a. P. 
Ot wed bax eB. Oe 
is called the mth convergent of the continued fraction (5.1). We put 


here 
Py bo Pix 1 


® 1’ QO, 0° 
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Basic recurrence relations: 
Py = bpPp-1+4nPn—» 
Qn = bnQn-1+4nQn-2 


Equations (5.2) enable the convergents to be evaluated successively. 
It is useful here to employ the following scheme: 


(nm = 1, 2, 3, ...). } (5.2) 


a a a 
Bates: pas ; 
OTR, Dy Laced By hea 

J Po A Pe Pn 
or Ooo, foo 


EXAMPLE 1. 


V2 =14+(J2-1) = 14+ 





1 
1+ /2 
1 


w=i4t i 3 tod 
- 242+ 24+ 2 4 24+ 
Bod es ots A gh 
0 1 2 5 12 29 70 


1 15 1:4 1417 14138 1-41429, 


The difference between neighbouring convergents is 


Bog = (cn (Qm=1,2,3, ..) (5.3) 


The difference between convergents whose indices differ by 2 is: 





Pati Pa-i _ ¢_ yynt1 192+ ++ AnPng = 

Qn+1 Qn-1 7 ( y Qn-19n41 ~ IL 2 ne ? oO” 
Continued fractions whose partial quotients have positive terms. 

It follows from equations (5.4) that, if all the terms of the partial 

quotients are positive, the convergents of even order form a mono- 

tonically increasing sequence, bounded from above by the number 

by+a,/b,. Such a sequence has a limit. Consequently, lim P,,/Q., 

n—->co 


exists in this case. Similarly, if all the terms of the partial quotients 
are positive, the convergents of odd order form a monotonically 
decreasing sequence, bounded from below by the number by. Such a 
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sequence also has a limit. Thus lim P,,_,/Q.,_ also exists. Thus 
N—> oo 
the value (if it exists) of a continued fraction, of which all the terms 


of the partial quotients are positive, is always greater than any con- 
vergent of even order and less than any convergent of odd order. 
The pumice sis n Py/Qn i is taken to be the value of a continued frac- 


tion (5.1). 


2. Transformations of continued fractions 


The fundamental na transformation is 
—_— = = 5 

Bb 2 ae 

Pr% PrP 242 Pn-1Pn&q (5.5) 
Pibi + Poby +--+. + Padn t+...’ 


where pj, Po,... are any numbers, finite and non-zero. 
Ordinary continued fractions. By using transformation (5.5), we 
can always reduce a continued fraction (5.1) to the form 


1 1 I 


ot— — _ i (5.6) 
hy +A +... Hayat... 
where 
a oe _ 4944+-- Q2p—2D2r—1 _ 43. - + Aan 1D 9r 
% = 99, Sp = sor? Fo 
QQ... Aop-y QnQ4... Aor 


We call (5.6) an ordinary continued fraction, while the numbers @,, 
O,... are the partial denominators of the ordinary continued 
fraction. 

An ordinary continued fraction with positive integral partial 
denominators is said to be regular. Only regular continued fractions 
are usually considered in the theory of numbers. 

Continued fractions, of which all the partial denominators are equal 
to 1. Such fractions are obtained from the fraction (5.1) by a trans- 
formation (5.5) in which we put p, = 1/b,(7 = 1, 2, ...). When 
by = 0, such a fraction has the form 

G4 Ce Cn 


a oe. 2 a 
Toot eye ee On 
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where 
Gea ek: gan 
eS I Oe BeBe 
The terms of the partial quotients of fractions (5.6) and (5.7) are 
connected by the relationships 
oad w” 7. Sn—1%n 
Daniel Bernouili’s continued fraction. The continued fraction, the 
convergents of which are equal to Ko, K,, Kz,..., has the form 
K,—Ky K,—Ky (Ki—Ko)(Kr— Ks) 
1 + K,—Ky+ K,—-K, +. ee 
(Kn-2— n—3) (Ky_-1— Kn) 
eS SS tS + : 5.8 
° + Kyn— Kn-2 + eee ( ) 
EXAMPLE 2. The continued fraction for which K, = 1/(#+1)? 
(n = 0, 1,...), has the form 





(mn = 2, 3,...). 





Ky + 








gai-2. WS 37 $9 Qn DQnt) 
~ 4.1-42-43-44-...- 4n —... 


2d 3 45 
1 4 27 240°°° 


3. Contraction and extension of continued fractions 


If we take as Ky, Ky, Ky,...some subsequence of convergents of 
fraction (5.1), we say that the fraction (5.8) has been obtained by 
means of a contraction of fraction (5.1). Whereas, if we take as Ky, Kj, 
Ky, ... @ sequence which includes in particular all the convergents 
of (5.1), we say that the fraction (5.8) has been obtained by means 
of an extension of fraction (5.1). 

After putting K, = P,,/Qon, we have 


a a An a,b, 
a ee ee ye a 
Aa4b, a,a5b,b, 
— (babs + 5)by + bay — (bys + 45)by + Bya5— - .« 
Fen —292n—102n—sbon (5.9) 


e+ = (Oen-aban—1 + Gan—Dban + bon—2dan — «++ 
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EXAMPLE 3 
1 1 2 #1 1 I 
Nt eae DES 6 Gite ce Go 
17 41 239 
7 5 9 169 


On putting K, = Poy4,/Qen41 We have 


Agee a Gai a ROI 
Ds ABy Po ae le Oe, Het 3 a4 - 
@,a_b, a,a,b,b, 


~ (byby + 4y)b3 + bya, — (b3by + a4); + b3a5— ... 


Qn 14andon—gban+1 
vee (O2n~102n + Gra)bang1 + O2n—142n41— + 
Here, the sign * indicates that the convergent of zero order of 
the continued fraction on the right-hand side of the last equation is 
the fraction 1/0, and not 0/1, since this continued fraction has for 
its convergents the convergents of odd order only of continued frac- 


tion (5.1). 
EXAMPLE 4, 
1 1 «5 1 1 1 
bae= =o ee ae pe aa ; 
BENS ET he a eg ag 6 es 


D 
1 5 29 169 985 
0 2 12 70 408 

If we replace the sign = by the usual equality, we get the expan- 


sion 
5 : 5.61 1 1 


-6-—-6-6 -. 
© 5 30 175 1020 
1 2 11 64 373 


The connection between ordinary and singular values of a continued 
fraction. If by = 0, the continued fraction (5.1) can be considered in 
two ways, depending on whether we take its zero order convergent 
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as equal to 0/1 or 1/0. In the first case the values of the continued 
fraction are described as ordinary, and in the second as singular. 
On writing K and K respectively for the ordinary and singular value 
of the same continued fraction, we have 


ni apes) pack 

~ bb tht...’ ~ by tbat...” 
0 ay aby lq a,b, + a, 
1 by bby ta, 0b  Bydy 


The continued fraction for which K is the ordinary value is 


bia, 
a 


g 


Bi. ee ee ; 
by—bt ei that ht... 
e 
1 





K= 


aq a,b, + a, 
bh, byby 


It follows that the connection between K and K is given by 


| eee . 
b,K+b,—a, 


4. The transformation of a continued fraction resulting from a 
theorem of Stolz 


The following is well known in mathematical analysis: 
STOLZ’s THEOREM. Let 
Lim P, = ~, Lim Q, = © Oni: > Qn 
n> oo n—> co 
for all n. Then 
m PrsinvPn 


if the limit on the right-hand side of the last equation exists. 

By using this theorem and the basic recurrence relations (5.2), 
we can transform the fraction (5.1) into a continued fraction, whose 
nth order convergent is (P,—P,_,)/(Q,—Q,_;), where P, and 
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P,_, are respectively the numerators of the mth and (m—1)th order 
convergents of the continued fraction (5.1), while Q, and Q,_, are 
the denominators of these convergents. This continued fraction 
has the form 





a a a at+b,—1 
beh ay ae i gt Og 
OTR pete. bal et 
a3;+6,—-1 a,+b,—1 
@,+b,—1 is ee PE hae. P 
a,+b;—1 7 an +b,—1 
+ b, ser ies +...¢), ania ee 
EXAMPLE 5. 
I 1 1 41 
ea tae ee 
1225 7 19 
1 1 3 4 IU 
Sige. Ae. ee 
a O+14+143 41434... 
dL 24 
1 0 2 2 414 


A more general transformation of continued fraction following from 
Stolz’s theorem. We apply Stolz’s theorem to the sequence 


aca oon ie 





YnQn 


where P,/Q, (n = 0, 1, 2, ...) are the convergents of (5.1), and yo 
Vis Ya...» are any non-zero numbers. Now, if the inequality y,Q, > 
Yn—1Qn—1 18 satisfied for all n, we have, by Stolz’s Theorem: 


lim Pn _ lim PnPaaYno1Pnoa 
n> co Qn neo YnQn— Yn-12n-1 , 


if the limit on the right-hand side exists. 
By using this equation and the basic recurrence relations (5.2), 
we can transform (5.1) into a continued fraction, whose nth order 
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convergent is (Y,P,—Vn—yPn—-v/OnQn—VYn-1Qn-1) This continued 
fraction has the form 


a Be an 
by toot... tbat... 


K = bot 


1 
—_— A + by — 
1a, Vy (V1¥242 + ¥0%252 - YoY) 


= by + 7 
Yb) — Yo + = b,-1 a 
v1 


V2¥33 + Vi¥303 — Vie 
ViV242 + VoVare— Yor1 
Y3b3— V2, Yo Y2Vs43+V17'303— Vive +--- 
+333 4,0 2s 
V2 Ya Vi¥242 + Yov252— Yor 
Yn—1¥n4n + Yn—2¥nPn —Yn-2Yn-1 
Yn—2¥n-19n—-1 + Yn—3?n-19n-17 Yn—3Vn—2 
di YnOn —Yn—1 + Ya-3 VYa—1¥n9n + ¥n—2¥ non — Vn—2Yn—1 
Yn=1 Yn—1 Yn—-2¥n—19n—1 + Yn—3?n—19n-1 — Yn—3Yn—2 
+e. 


any 


EXAMPLE 6. 


2 5 Ii 95 319 . (PB —3n+1) (2 +n—- 1) 
F42412 +26 $4440.04 °° °=920F 3) OS 
§ 15 235 7535 

13 I 165 5335 

This gives us an expansion of V2 as a non-periodic continued 
fraction. In number theory there is a theorem which asserts that every 
irrational square root can be expanded as a periodic continued 
fraction and that, conversely, the value of every convergent periodic 
continued fraction is some irrational square root. But it is not always 
pointed out that an irrational square root can also be expanded asa 
non-periodic continued fraction, there being an infinity of such ex- 
pansions. The expansion. of yf 2 obtained by us as a periodic con- 
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tinued fraction is more slowly convergent than the initial expansion 
of af ¢ 

Corollaries of Stolz’s theorem and transformations of continued 
Jractions following from them. Let the sequence {P,,/Q,} satisfy the 
conditions of Stolz’s theorem. The sequence {P?/Q?} now also 
Satisfies the conditions of the theorem. Therefore © 


Sar, 20, . PrtPr- 
lim —=“im: 2 
n> oo Qn n-» co On+Qn-1 


We can obtain, on the basis of this equation, the following trans- 
formation of a continued fraction: 


a Qn - a; 
Pee Ape Ge OP as = 
bs—a3+1 | ba— an +1 Pa 
by—- a +1 by—a,+1 7 bai—Ga-iti 
— bo+1 + b,—a,+1 ; by— an +1 
So as ai eet by-1—-4@n-i tit... 
EXAMPLE 7 


= ee ee ae ee 
2-3434+4434+14... 
The following equation may also readily be obtained from Stolz’s 
theorem: 
af “PR YnPntVn—nPn—r 
lim — = lim "27s ‘ 
n—>e2Qn noo YnQntYn—-kQn—k 
where {y,} is a sequence, the terms of which are all non-zero. We 
can obtain on the basis of this equation as many different identity 
transformations of a continued fraction as desired. 
A further transformation of continued fractions. Let us consider the 


identity 
ae DS (5.10) 


OT bth tas Te ap bec 
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Let us suppose that the convergents of even order of the fractions 
appearing in this identity are equal if their indices are the same. 
Now, on performing a contraction of the continued fractions and 
using the basic identity transformation to make corresponding terms 
of partial quotients of the contracted fractions equal, we obtain the 
following two systems of equations, connecting the terms of the 
partial quotients of the initial continued fractions: 


— botyd, = a,bp, 


5.11 
Calg, = 0,034, oN 
and Con—2Con—199n = G2n—292n—1P2n—4ban 1 = 2, 3, .... 
Cd_ + dd, + Cy = bb, +a, 
(dan—24dan—1 + Con—1)4an + dons2Con = (5.12) 


= (ben—-20on-1 +4gn_ bon + bon_2don (n = 2, 3, ...). 


Systems (5.11) and (5.12), taken together, contain 2n equations 
with 4n unknowns c¢, and d, (n = 1, 2, ...). It is thus impossible, 
in the general case of equations (5.11) and (5.12), to express c, and 
d,(n = 1, 2, ...) im terms of a, a,..., 5, bg,... Or, conversely, 
ay, 5, (nm = 1, 2,...) in terms of ¢, Cg,..., dh, dy, .... Butif by = 
=1, Ch = —G, don = bans don—1 = Anven—1 (n= 1,2,... 3A, ~ 1), 
the identity (5.10) takes the form 


a a an 
Le — = 
HR tbe tiene Be Rahs 
een ee en 
1 — Ayby =- byby + 2a, — 1 — bebgb, + 2a3b, + 24,5, — 1 wee 
Qon_1D2n Qondon—2 
ee ban—2ban-102n + 242n—-152n + 2gndon—2 — 1 it 
(5.13) 
EXAMPLE 8. 
1 1 1 2 1 1 1 1 1 
2=l1+—- — eee ee - Bs 
V2 = 14754 (gee ae ee eee ee reas ee 
ol 8 7 48 41 280 239 
11 6 5 34 29 198 169 


252 MATHEMATICAL ANALYSIS 


If the equations 


by = 1, Sp ep pe =..., (5.14) 
are satisfied, then equation (5.10) takes the form 
aA & on 2 
Di tbat... tog tice 
Fe a a Gant. Fan . (5.15) 
1-6, +b, 4+ b3+...+ Ben tbengit.-- 


5. The properties of regular continued fractions 


A continued fraction in which all the partial numerators are equal 
to unity, and all the partial denominators are positive integers, is 
described as regular, or arithmetical. It follows from equation (5.3) 
that all the convergents of a regular continued fraction are non- 
reducible. 

Euclid’s algorithm and the expansion of rational numbers as regular 
continued fractions. Let u and y be two given positive integers, where 
u> yv. On dividing u by v, we have 


uo 44 
ae vy? 


where qp is the quotient and u, the remainder. On dividing v by 14, 
we have similarly 


v Us 

“ nt uy " 
Proceeding in this manner, we get 

4 og 

Up = % + Ug 


and so on. This process of successive divisions is known as Euclid’s 
algorithm. Since u, u, tu, ... is a monotonically decreasing sequence 
of positive integers, the process is finite, i.e. there exists an index n 
such that u,_,/u, = 9, (consequently, u, ~ 0, u,,, = 0). Hence 
u,, is the greatest common divisor of the numbers u and y. It is often 
denoted by (u, v). 
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EXAMPLE 9. Find the greatest common divisor of the numbers 
816 and 323. 
The computation is usually set out thus: 


816/323 
646 3 
323| 170 
470. 1: 
170| 153 
153}17 1 
0 9 


(816, 323) = 17. Thus the expansion of 816/323 as a regular continued 
fraction has the form 


816 1 1 1 
co acl Ow) 
23 5 #& 
1 1 2 19 


Thus Euclid’s algorithm enables us not only to find the greatest com- 
mon divisor of two positive integers, but also to expand their ratio 
as a regular continued fraction. 

The solution in integers of an indeterminate equation of the first 
degree with the aid of Euclid’s algorithm, The equation ax+by =, 
where a, b and c are known, while x and y are unknown, is known 
as an indeterminate equation of the first degree. Such an equation 
has an infinite set of solutions. But it is often required to find only 
the integers that satisfy the equation, ie. in conventional language, 
it is required to solve the equation in integers. We consider here only 
equations for which a, b, ¢ are integers. The equation ax+by=c 
has an integral solution only in the case when c is divisible by (a, 5). 
We can thus always assume that a and b are mutually prime. In this 
case the general solution in integers of the equation has the form 


x = (—1)""'eQn_1 + tn, 
y= (- 1)"cPp_1— tPas 


where ¢ is an arbitrary integer, P,_, and Q,_, are the numerator 
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and denominator of the penultimate convergent in the expansion 
of a/b = P,/Q,, as a regular continued fraction. 
EXAMPLE 10. 43x+37y = 21. 


43/37 43 td 
seT 7 E+E 
Siu 6 1 7 43 
0 6 1 6 37 


— 21.64 371 = 37t— 126, 
y = 21.7—43t = 147-432, 


ie. 
x = 371-15, y= 18—431, 


where again, ¢ is any integer. 

The convergents of a regular continued fraction as best approxima- 
tions. Suppose we have expanded any real number A as a regular 
continued fraction. Let us write P/Q, for the mth order convergent 
of this continued fraction. The following inequality now holds: 
Pr 


a0. 


1 


<= ——— 


NeN+1 








These convergents are best approximations to the number A in 
the sense that no rational fraction with denominator not exceeding 
Q,, can differ from A by less than the fraction P,/Q,,. 

The expansion of an irrational number as a non-terminating regular 
continued fraction, Every real irrational number can be written uniquely 
as a non-terminating regular continued fraction. Conversely, every 
non-terminating regular continued fraction (such a fraction is necessar- 
ily convergent, by Seidel’s convergence test, see § 2, sec. 2) is the 
expansion of one and only one real irrational number. 

Periodic regular continued fractions. The regular continued fraction 

1 1 
U+d.t.-. 
42, -.. Of its partial denominators consists of a repetition, with 
the same period, of the m numbers gp, q,-+ +) Yn—1 

If the repetition starts with some q,(k = 1) instead of with qo, the 
regular continued fraction is described as mixed periodic. 


Got is said to be purely periodic if the sequence qo, 4), 
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Similar concepts of periodic continued fractions may also be intro- 
duced for continued fractions of a general type, although regular 
periodic continued fractions are primarily discussed in number 
theory. 

The expansion of irrational square roots as periodic continued 
fractions. Every periodic continued fraction (not necessarily regular) 
represents an irrational square root. An important role is played 
in number theory by a theorem of Lagrange, which states that 
every irrational square root can be expanded as a periodic regular 
continued fraction. 

For example, 

V5 +1 1 1 1 
Qe eT Pas 


Ji = 344 | ies eee es as So Fees | 
T+1+14+1+64+1+1+1+6+. 


Notice that the expansion of 13 as a continued fraction of general 
type, 
2 1 1 «421 
V13 = 34+(/13-3) = 34+—= =34+-—- —- — = - 
( ) 3+ 5 343434+3+... 
is obtained more simply and is more rapidly convergent. Thus the 
expansion of irrational square roots as regular continued fractions 
is more of theoretical rather than practical interest. 





6. Equivalent and corresponding continued fractions 


When transforming the power series A +A,x+A,x?+... 
into a continued fraction, two cases can be encountered: (1) the 
convergents of the continued fraction coincide with the partial sums 
of the initial power series; (2) the convergents do not coincide with 
the partial sums of the initial power series. In the first case the con- 
tinued fraction is described as equivalent to the initial series, and in 
the second case as corresponding to the initial series. The expansion of 
the nth convergent of the corresponding continued fraction as a power 
series coincides with the initial power series up to and including the 
term in x", It is clear that an equivalent continued fraction is only 
another form of writing a power series and does not yield new appro- 
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ximate expressions for its sum..As regards convergence, a power or 
numerical series and the continued fraction corresponding to it can 
behave differently. They may be both convergent, or both divergent, 
or one be convergent and the other divergent. The domains of conver- 
gence of a power series and the continued fraction corresponding 
to it may thus be different. For instance, there are power series with 
radius of convergence equal to zero, which can be transformed into 
corresponding continued fractions that are convergent in a fairly 
wide domain. 

Equivalent continued fractions can sometimes be readily transform- 
ed into corresponding ones by means of the transformation (5.13). 
Since it is far easier to construct the equivalent rather than the 
corresponding fraction, the application of transforming equivalent 
fractions into corresponding ones is of practical interest. 

The construction of equivalent fractions. For this purpose it is 
easiest to employ Euler’s identity: 








yeah ee ak CoX C1CgX Cn—2CnX 
n=0 — Cyt lCgx — Cg + CgX — eee m Cui HCnX— «ne 
(5.16) 
This identity can also be given the form 
y Cax® = Lo Cx CoCoX C1C3X 
n=0 1 — cot ex Cy + OQX—Cotcgx— ... 
Ra rat ie . (5.17) 
» — Cpu tlpX — wee 
EXAMPLE 11. 
arctan x = pase ate a 
ie COE Raa 
= eo 9x? (2n — 1x? : 
~ 1 43—x? + 5—3x2 4+... +2n41—(2n—1)xX? 4+... 


In particular, when x = 1 we have, 


zaoire er FP Qn—-1P 

1 142424+24+24...¢ 2 +... 
O1 2 18 76 789 

11 3 15 105 985 
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The last expansion was first obtained by Brouncker (1620-1684). 
This relationship is regarded as historically the first expansion of 
a transcendental number as a continued fraction. 

On applying transformation (5.13) to the expansion of arc tan x 
as an equivalent continued fraction, we get the continued fraction 


arc tanx = x— cuss a 
= 15 +9x? _ 1 ear 
x 15x+4x243x5 15x—5x3+3x5 
1 15 +9x? 15 


which is no longer equivalent. In particular, when x = 1 we have 


2 9 2% @ 81 QI 
24-1-—152- 1 —408-...- 1 - 


1 22 13 1426 789 


1 24 15 1680 945 


wu 
ao 


(4n+ 1)? 
— Bn? +8n4+3) —..." 


7. The formation of corresponding fractions. Viskovatoy’s method 


The terms of the partial quotients of the corresponding continued 
fraction can be expressed in terms of the coefficients of the terms of 
the initia] power series, although high order determinations appear in 
the relationships thus obtained. This makes such relationships of 
little practical use in the majority of cases. It is therefore better in 
practice to use a method of successively obtaining the terms of the 
partial quotients of the corresponding continued fraction from the 
terms of the power series. Such a method was proposed in principle 
at the beginning of the nineteenth century by the Russian scholar 
V. Viskovatov. Viskovatov’s method amounts to the identity, 


f@) = yg HXyyX +A yqQX* +g +... — “10 S0% Manx 
Sqn Hq HA pgX*+A%qgxP+ ... Ayg+ hig + Mog +...” 


where 


Smn = %m—1, o%m—2, n+1— &m—2, 0%m-1, n+1° 
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Computation of the coefficients a,,,, may be conveniently set out 
in accordance with the scheme: 


rr er ee 


EXAMPLE 12. Let us expand the expression (1— x)/(1—5x+ 6x?) 
(x < 1/3) as a continued fraction. We have 








1 -5 6 
1 -1 
-4 6 
—2 
~ 12. 
Consequently, 
I-x _ 1 4x 2x 12x _ 
1—5x+6xe?  T- 1 —- -4- =a 
het de a 
1- 1 + 2 - 1 
1 1 24x 2—2x 
1 


If, when computing the coefficients «,,,,, it turns out that «,, = 0, 
then the (k+2)th row of the scheme is obtained by means of a shift 
of the (k+ 1)th row one place to the left; the (k + 3)th row is obtained 
by combining the (k+2)th and the kth rows in accordance with 
the general rule, the (k+4)th row by combining the (k+3)th and 
(k+2)th, and so on. The expansion in this case has the form 


fle) = Zia, S20% %a0% 


Xoo + %o + yo +... 


2 a - 
Sp_1,0% %h,iX° Spir,iX %k+20,1% 
ae ee ee . 
ses FOpeo F&e-1,0+ %r,1 + Shtiz1 t--- 
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EXAMPLE 13. Let us expand the expression (1 —3x*)/(1—x?— 4x‘) 
(x? < (./17—1)/8) as a continued fraction, we have 


I=3e9 Lt Be Sx 25x 300 1S _ 
1—x?-4x4 ~ 1-1 --1—--—34+-5+ 25-1 — 
eile ain Se sx 
Ss. Taw i. OS Bra: 
01 1 1+3x 3+34x 
11 tx? 143x—x® 344x—3x? +53 
Sx 12x 3x 
rs os = 5 = i 
349x + 15x? 15 +9x+27x? 15—45x3 
349x+12x? 1549x+12x? +36x3—60x4 15—15x?—60x4 * 
1 0 -1 0 ~—4 
1 0 0 —3 
0 —!i 3 —4 
-1 3 -—4 
~3 4 3 
-5 15 
25 —15 
300 
— 300.15. 


8. Appell’s method 


In 1913 Appell proposed the following method enabling any 
positive number to be expanded as a continued fraction. 

Let N be any positive number. Let a be the square root of N, comput- 
ed with a deficiency of not more than 1. Thus N = a?+-R, where 
0 < R < 2a+1. Weshail assume a = Oif N< 1. We put R = (2a+1)/Mj, 
where N,>1. Let a, be the square root of N,, computed with 
deficiency of not more than 1. Then N, = a?+R,, where 0< R,< 
~=<2a,+1. We put R, = (2a,+1)/N, and continued this process inde- 
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finitely. Generally speaking, N is now expanded as a non-termin- 
ating continued fraction. 

If N, = N, Nis expanded a pure periodic continued fraction. If 
N, = N,,(1=m <p), N is expanded as a mixed periodic continued 


fraction. 
EXAMPLE 14, 
5 § 5 
= M2y = 2a pe a 52g 
5 = 2+] v+5: N,=WN, 5 ia ae 
EXAMPLE 15 
3 3 3 3 
— 242 oe te oe 
2 
5 5 3 
ei-90 Se! A e g8iy e = 
Oe ie 5) la eom N; = N. 
2 
3 3 3 =5 3 3 
See ee es 
miele Way) Pes Len gras 
eon 
EXAMPLE 16. 


Lees er 3 3 


4 P+ P+ 
Appell also pointed out the more general relationship 


{@Htna (+ Dt=a5 
a? + ad eee 


Here a,, a,... are positive integers, while a may also be equal to 
zero. Here we can take the nth root of the number with a deficiency 
or with an excess of not more than 1, or we can even alternate in 
various ways the approximation of the root with a deficiency and 
an excess in the expansion obtained. 


Nz=a 
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§ 2. Fundamental tests for the convergence of continued 
fractions 


1. The convergence of continued fractions 


It was mentioned above that a continued fraction for which lim 
n-—> co 
P,,/Q,, exists and is finite is described as convergent. The value of the 


continued fraction is in this case taken equal to this limit. But it does 


not follow from the convergence of a continued fraction that lim 
NR» co 


P,/Q@, is equal to the magnitude which has been expanded as the 
continued fraction. 
Essentially and non-essentially divergent continued fractions. If 


lim P,/Q, = + ~ or lim P,/Q, = — , the continued fraction is 

n—->oco n—>oo 

said to be non-essentially divergent, whereas if lim P/Q, does not 
n—> oo 


exist, the continued fraction is said to be essentially divergent. The 
concepts of essential and non-essential divergence were introduced 
by Perron. 
Unconditionally and conditionally convergent continued fractions. 
Unconditionally and conditionally convergent continued fractions. 
It is well known that the convergence of a series or infinite product 
is not affected by the removal of a finite set of terms. In continued 
fractions, however, the removal of a finite set of partial quotients 
(excluding the zero partial quotient) can turn a convergent fraction 
into a non-essentially divergent fraction. Pringsheim therefore intro- 
duced the following concepts: a continued fraction [a,/b,]? is 
said to be unconditionally convergent if, for all m = 1, the fraction 
{a,/b,]% is convergent. Whereas if the latter fraction is divergent 
for at least one value of m, the fraction [a,/b,]? is said to be 
conditionally convergent. It follows from this that it is not in general 
possible to quote convergence tests for continued fractions in the 
limiting form as used for series. The convergence conditions, connect- 
ing, say a, and b,, must be satisfied for all positive integral n. It 
‘must be emphasized that the removal of a finite set of partial quotients 
can turn a convergent continued fraction only into a convergent or 
a non-essentially divergent fraction. 
A necessary test for the convergence of a continued fraction [1/a,]>. 
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Kocu’s THEOREM. The convergence of the series } |a,| is 
sufficient for the sali noe =P, Spa 1 Pon 41 =P’, lim Q,, = Q, 
lim Qon41 = Q' to be pas and the relationship P' Q-—PQ' = 1 to be 


N—> co 
satisfied. It follows from this that the divergence of the series 3 Ja, | 
n= 
is necessary for the convergence of the fraction [l/«,]}>. : 
Uniform convergence of a continued fraction. If the terms of the 
partial quotients of a continued fraction are functions of a finite 
or infinite set of variables, the continued fraction is said to be uni- 
Sormly convergent on the set E of variation of these variables when 
its convergents P,/Q,, tend uniformly to a limit in £, i.e. when, given 
any e > 0, we can find a number N such that, for n = N, Q,is non-zero 
on the whole set E and the following inequality holds: 


P. 
— lim — 


a A> co Q, 
It follows from this definition that the series (see [3]): 


Py = P, Py-y Py = A- QQ, ...Q, 
= es =o + | 5 Use oak aaa 
Qn “ A= N+1 (2 Qi-1 :) Qn me ( ) 04-19, 


(5.19) 


ae (5.18) 











is now uniformly convergent in E to lim P,/Q,, since P,/Q,, is its 
n— co 
partial sum, while lim P,,/Q,, is its sum. Conversely, condition (5.18) 
N—> oo 
follows from the uniform convergence of this series, i.e. the uniform 


convergence of the continued fraction. It also follows from this 
definition that the values of the continued fraction and of the series 
(5.19) coincide for any x € E, i.e. that the continued fraction and the 
series (5.19) are identically equal on the set E. 

A condition for the convergence of a continued fraction to the function 
which can be expanded as this continued fraction. The uniform converg- 
ence of the continued fraction 


oi ee fat (cp #0; n=1,2,...) (5.20) 
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on the set E is a sufficient condition for this fraction to be convergent 
on the set E to the function K(x), which can be expanded as the con- 
tinued fraction. 

It follows from this theorem that, if the fraction (5.20) is uniformly 
convergent for |x| <@, itis convergent for |x| <o to a regular single- 
valued analytic function, which can be expanded as the fraction 
and which can be expanded as the power series corresponding to the 
fraction (5.20), this series being convergent to the same function 
for |x|<@. The condition is therefore obtained in order that the 
continued fraction and the power series which correspond to each 
other are convergent to the same function. Notice that the domain 
|x |< can be replaced by any domain T containing zero as an interior 
point. 

If zero is a boundary point of the set E, then 9 = 0, i.e. the power 
series corresponding to the fraction (5.20) is divergent everywhere 
except at zero. But the fraction (5.20), uniformly convergent on the set 
E, is nevertheless convergent on this set to the function that we have 
expanded as this continued fraction. This function can be expanded 
in the present case in a neighbourhood of zero as a divergent power 
series, i.e. it is not analytic. The convergents of the fraction (5.20) 
are thus approximate expressions for a non-analytic function, i.e. 
we have to some degree solved the problem of the approximate 
evaluation of non-analytic functions. 

The condition for identical equality of two uniformly convergent 
continued fractions. If the values of two continued fractions, uniformly 
convergent inside a domain T containing zero as an interior point, 
are coincident in a domain S which is contained wholly in 7, then 
these fractions are identically equal inside the domain T. 

Uniform convergence of the fraction [c,x/1},,,. The uniform 
convergence of the fraction [c,x/1];,, inside a domain T con- 
taining zero is sufficient for the uniform convergence inside T of the 
fraction K(x) = [c,/1; ¢,x/1}}, after the possible exclusion of a 
finite number of points x’ of non-essential divergence. The fraction 
[c,/1; c,x/1]3? is convergent here inside T to a single-valued 
analytic function K(x), regular inside T, except at points x’, which are 
the poles of this function. 
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2. A necessary and sufficient test for the convergence of a 
continued fraction in which the partial quotients have 
positive terms (Seidel’s test) 


As has been shown, the divergence ofthe series )' |a,,| is necessary 
n=l 
for the convergence of the fraction [I/a,]°. Seidel, and independ- 


ently Stern, showed that if all the terms of the partial quotients of 
the fraction are positive, the divergence of the series is necessary and 
sufficient for convergence. 

EXAMPLE 17. The continued fraction 


1 1 1 
Leip ae 
is convergent by virtue of Siedel’s test, since the series 2+2+... 
is divergent. 

Notice that the convergence of a continued fraction in which the 
partial quotients have positive terms depends on the divergence of 
a certain series, i.e. the behaviour of the entire set of terms of the 
partial quotients, not on the behaviour of each of them. A convergent 
continued fraction in which the partial quotients have positive terms 
is therefore unconditionally convergent. 

On passing from a continued fraction of the form (5.6) to a con- 
tinued fraction of the general form (5.1), the following statement of 
Seidel’s test is obtained; this statement was proposed by Stern. 

The divergence of at least one of the series 


SA 2. + Aon 1 Gey... Ay 
. = bon, > =r bonat (5.21) 
mm1 4244..-Gon n= 4143 - +» Gon+y 
is necessary and sufficient for the convergence of the continued fraction 
(5.1), of which all the terms of the partial quotients are positive. 


3. Tests sufficent for the convergence of continued fractions 
in which the partial quotients have positive terms 


Establishing the divergence of one of the series (5.21) is usually 
fairly difficult in practice. Thus it is often more convenient to make 
use of various tests which are sufficient for the convergence of conti- 
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nued fractions with partial quotients having exclusively positive terms. 
Some of these tests are given below. 


1°. Divergence of the series } (b,_,6,)/a, is sufficient for the 
-n=g 
convergence of the fraction (5.1) when the partial quotients have positive 
terms (Stolz). 
2°. Divergence of the series > Vn )n)/On is sufficient for 


n=2 
the convergence of the fraction (5.1) when the partial quotients have 
positive terms (Saalschiitz and Pringsheim). 
3°. Divergence of the series 
bas 1 
n=2 an 
I+ 
bain 





is sufficient for the convergence of the fraction (5.1) when the partial 
quotients have positive terms (Arndt). 
Notice that, if 
ee an 
TOO ee hs dene oe 
then 
Sie Gn 


-K= -8, a. ete : 
of —by+ —bat... todat... 


Hence all the tests for convergence of continued fractions in which 
the partial quotients have exclusively positive terms may readily 
be extended to continued fractions in which all the partial numerators 
are positive and all the partial denominators negative. 


4. First set of tests sufficient for convergence 


Let the numbers 7, 72,... satisfy the following conditions (Scott 
and Wall), 


1) ry [lL t+ey| = | el, 

2) rz |1L+cg+cs| = |cs|, 

3) trl l+ent+en4il & Paln—2lCnl +] cn42! (n = 3), 
4) r, 20 (n = 3), 


(5.22) 
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where Cp, C3,... are the partial numerators of the fraction 


_1 & & Cn 
OTe Pe Tada a C2) 


If the series ¥° ryrg...1, is convergent, then the fraction (5.23) 
n=l 
is convergent, while 


[K]) 314+ ¥ nr... (5.24) 
n=l 


If the numbers 7, r,,... satisfy conditions (5.22) and at least one 
of the c, is zero, the fraction (5.23) is convergent. 

If cy, Co,... are functions of several variables, the above converg- 
ence test takes the following form. Jf the numbers r,, ro,... satisfy 


conditions (5.22), and the series }\ r,r,...1, is convergent on a set E, 
nel 
the fraction (5.23) is uniformly convergent on E, inequality (5.24) 
being satisfied. 
In particular, the set E can be chosen on the basis of the following 
theorem due to Scott and Wall: 


The set of conditions 


Pa-1 


>1, |e,|s 
m n| Pn-1Pn 


(n = 2, 3,...) (5.25) 


where p,, Pz are the terms of some numerical sequence, is sufficient 
for uniform convergence of the fraction (5.23) and for the following 
inequality to be satisfied: 


Pi ge gcse ne aa 59896) 
Py-I > 
. 1+ ¥ G@i-D(m-1).--@a-1) 





nel 


Inequality (5.26) becomes equality if c, = (l—p,)/p,_,P, (n = 2, 
Sia) 


If p, = 1, Scott and Wall’s theorem takes the following form. 
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The following conditions: 
(1) p, = 1; 


-1 
(2) len #5 “(= 2, 3}. sve) 
n-lEn 


(3) the series ¥ (p.—1)(p3—1).-- (Pag3—1) is convergent; 
nal 


are sufficient for the uniform convergence of the fraction (5.23) and 
for fulfillment of the inequality 


|K| s 1+ ¥ @—D(P-0)---@nsa—D. 


This becomes equality if c, = (1—p,)/P,_1P, (nm = 2, 3, ...). 
In particular, of p, = (2n+1)/(n+k), the following theorem is 
obtained, by virtue of (5.25) and (5.26). 
The condition 
n? —(k—1)? 
4n? —1 
is sufficient for the uniform convergence of the fraction (5.20), while 
we have: when k # 2, 


3 1 
IKl S5-% ‘Ty eek ok Wece | 
2. 7Sk DER nee 


leal S 


(n= 2, 3, ...) (5.27) 





An investigation of the series in the denominator on the right-hand 
side of the last inequality shows that the series is convergent for k > 1 
and divergent for k = 1. In addition, it follows from inequality (5.27) 
that ~1< k <3. Hence, when ~1<k 3S 1 (5.28) takes the form 


[Klen- (5.29) 


and only retains the form (5.28) for 1< k <3. 
Vorpitskii’s test. When k=1/2, we have p,=2. In this case 
(5.27) takes the form 


1 


ve (n = 2, 3, see ) (5.30) 


lenl S 
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while | K] = 2 in accordance with (5.29), But we can replace (5.29) 
by the stricter inequality: 


pees, (5.31) 


4 
3 





VAN VLECK’S THEOREM. The condition 
0se,38 (n = 2, 3, ...) (5.32) 


is sufficient for the fraction K =[1/1, c,z/1]p to be convergent in 
the circle |z| < 1/4g to a regular analytic non-rational function, which is 
also equal to the series corresponding to this fraction, while | K— 
- 4/3| S 2/3. 

The proof of this theorem follows from Vorpitskii’s test. 


5. Tests for the convergence of continued fractions periodic 
in the limit 
The fraction {a,/b,)°, for which a, # 0, lima, = a, lim b, = 5, 


v—> oo v=—> co 


is described as periodic in the limit. Such fractions are of great practical 
importance, since they are connected with the expansions as continued 
fractions of a large number of commonly encountered functions. 
The convergence tests for continued fractions periodic in the limit 
follow from the theorem: 
The condition lim sup {|c,|} Sg is sufficient for the fraction 


v=—> co 
a, 1 
[# | (5.33) 


2 


to be convergent in the circle |z|< 1/4g (excluding possible poles) to a 
regular analytic non-rational function, the poles of the latter being 
the points of non-essential divergence of the fraction. In a neighbourhood 
of zero this function is equal to the series corresponding to the continued 
fraction (5.33). 

Having chosen as the g in this theorem any positive number, as 
small as desired, we pass to the following theorem. 

The condition lim c = 0 is sufficient for the fraction (5.33) to be 


vy —> oo 
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uniformly convergent in any finite domain of the complex plane, excluding 
a finite set of points of non-essential divergence, to an analytic function, 
which is regular in a neighbourhood of zero, and is regular in the re- 
mainder of the domain except for the above-mentoined points of non- 
essential divergence of the fraction, these being the poles of the func- 
tion. The point z = © is essentially a singular point of the function. 


To generalize this theorem, we assume that lim c, = c ~ 0. We 
v—>oco 
thus arrive at the following theorem. 


The condition lim c, = c # O is sufficient for the uniform converg- 


v=—> co 
ence of the fraction (5.33), excluding a finite set of points of non- 
essential divergence in any domain T T, where T is the complex 
plane with a cut along the real axis from the point (—1/4c, 0) to an 
infinitely remote point, such that the cut does not pass through zero. 
If the cut starts from zero, the following Stieltjes test holds. 
Suppose the following conditions are satisfied: 


(1) &, %,... are real and non-negative; 
(2) &, %,--+s%ongyr--- are not all zero; 
oo 


(3) the series 5° a, is divergent. 


kei 
Then the fraction [z/a,];° is uniformly convergent in any finite 
domain lying inside the complex plane, cut along the negative part of 
the real axis. 


§ 3. The expansion of certain functions as continued 
fractions 


1. Lagrange’s method 


Lagrange proposed the following method of solving differential 
equations with the aid of continued fractions. Suppose we have a 
differential equation in y and x, and assume that y ~ &, when |x| ~ 0. 
We now puty = &)/(1+y,) and substitute this relationship into the 
original equation. We obtain a differential equation in y, and x. 
Suppose y, ~ &, when |x| ~ 0. We put y, = &,/(1+ 2) and repeat 
the process. All in all, we arrive at the solution of the original 
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equation in the form of the continued fraction [&,,/1]>; &, is more 
conveniently sought in the form a,x’*, where pv, = 0. 

Many differential equations can be solved by this means, but it 
generally proves difficult to find the dependence of €, on the index 
n, i.e. to find the general partial quotient of the continued fraction. 


2. Fundamental differential equation 


Let us apply Lagrange’s method to the equation 
(a +a'x)xy’+(B+B'x)y+ yy? = Ox, 0) =0. (5.34) 


Having put y = 6x/(a+f+y,), the equation is reduced to the 
form: 


(a +0’x)xy' + [ao +B -(@’ +8)x1y +92 = [(@ +B)’ +8) +70]x. 
On repeating this process, we get the continued fraction 


y= 6x [t+ B)@'+B)+y8lx (@e’- af’ +0'B + yd)x 


a+B+ 2a +B + 3a +B tees 
[ax + B(x’ +B’) +yd)]x _(rxa’ — na B’ + na’B + yd)x 
+ 2na +B + (2n+1)x+B ee 


It is readily seen from this that the differential equation 
(a +a'x*)xy’ + (B+ B'x*)y+ yy = dx*, y0)=90 (5.35) 
has the solution 
— Ox [ka +B) (ka’ +B’) + pd)x* 
ka+B+ dka +B + 
(kacx’ — kaB’ + ka'B -- yd)x* 
+ 3ka+ B a Sh 
[(mko +B) (mka’ + B’) + yd]x* 
coo 2nka +B + 
(r®k? xa’ — nkaB’ +-nka’B + yd)xk 
+ (2n+1)ka +B assdae 


y 


(5.36) 


Almost all the differential equations, the solutions of which were 
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expanded as continued fractions by Lagrange, Euler and others, are 
particular cases of equation (5.35). It is therefore natural to refer to 
(5.35) as the fundamental differential equation. 


3. The expansion of a power function as a continued fraction 


Let us put y = (1+ x)’, where v is any real number. Then (1+ x)y’ = 
=vy = vy, y(0) = 1. On putting y = 1+ »x/(1+z), we reduce the 
differential equation to the form 


(1 + x)x2’ +[1—(1 — »)x]Jz +2? = (1—7)x, z(0) = 0. 
This is a particular case of equation (5.35), in which 

ksase’=Pa=y=1, PP =—-(1-», d=1-». 
We thus have, from expansion (5.36): 


wm (1—»)x (1+ 7)x 
1+ 2 4+ 3 + 
(2—)x (n—v)x (n+ )x 
+ 2 F...+ 2 $2n¢] 40.0 





(14x) =14 
(5.37) 


This expansion was obtained by Lagrange. In view of the above- 
mentioned convergence tests, it is convergent on the complex plane 
cut along the real axis from x = —xotox= —1. 

The power series into which the function y = (1+ x)” can be 
expanded is convergent in an open circle of radius 1 with centre at 
the origin. The expansion of the function y = (1+x)” as a continued 
fraction is therefore convergent in a much wider domain than the 
expansion of the same function as a power series. 

EXAMPLE 18. On putting x = 1, » = 1/3, we have 


2 4. 5 3n-1 _3ntl 
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On contracting the expansion (5.37) in accordance with formula 
(5.9), we get 


ee 2x (1 — 1?)x? 
ro ae 2+(1—»)x — 3(24+x) — 
(4—)22 (n? — 9) x? 


— 5Q4x) —...-Qn¢)Qtx—..." 


This expansion is convergent in the same domain as the expansion 
(5.37). 

Irrational square roots may be expanded as continued fractions 
by means of the following elementary method. 

Let /x sa. Then Vx = a+(/x—a) = a+(x—a?)/(at+Vx). 
Consequently, 


Gage ee 
mere + 2a +. 





This expansion is convergent on the complex plane, except the nega- 
tive part of the real axis. 


4. The expansion of a logarithmic function as a continued fraction 


Expansion (5.37) can be put in the form 
(l—»)x (1+ 7)x (Q—»)x 
rd, Se Bn ee 2 


(2+ »)x (n—v)x (n+v)x 
+ 5 +...4% 2 + 2n¢]1 4..0 


(l+x)y-1 


, 











ae: 
~ 4] 








On setting » = 0, we obtain, since lim [(1+x)’—1]/r = In(1+x): 
v—>+00 
x x xX 2x 2x mx = nx 


a ad Rg a Be cg ae, ce +242n+i+...° (5.38) 


This expansion and the method of obtaining it from expansion (5.37) 
were found by Lagrange. Expansion (5.38) is convergent on the 
complex plane cut along the real axis from x = —o tox= —1. 
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Exampig 19, On putting x = 1, we have: 


1 1 n 


In2 = ae 

ss Er kN me AB So 
2.9. 

1 





lo 


10 


5. The expansion of an exponential function as a continued fraction 
On replacing x by x/v, expansion (5.37) takes the form 


l-» l+» 2-9 
. x ——x x 
x x v v ” 
Sse => 1+— ———— Se oh eee 














eS) tease Oe need) ee 
On letting » tend to oo, we obtain in the limit: 


x X %X X x x 


x 
gmt nar Pao We ac en i en By oe ee, 


(5.39) 
This expansion is convergent on the entire complex plane. The expan- 
sion and the method of obtaining it from expansion (5.37) were 
discovered by Lagrange. On contracting the continued fraction 
(5.39) in accordance with formula (5.9), we arrive at the expansion 
obtained by Euler: 


2x x2 x2 x? 


a pee eee Ieees } 
Pet 6 4104.00 DEOnd De 


This expansion is also convergent on the entire complex plane. 


6. Expansion of the function y=arc tan x as a continued fraction 


The differential equation for this function has the form 


j l = 
y as yO) = 0. 
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On setting y = x/(1+z), this equation reduces to the form 
(1 + x?)x2’+(1—x*)z+27 = x*, 
This is a particular case of equation (5.35), in which 
a=e’=fP=y=6=1, fP=-1, k=2, 
We therefore have, from expansion (5-36): 


x? 4x? 9x? n®x? 
+3454 74... +2n4¢]4...° 


x 


l+z G20) 


arc tan x = 





ee: 
ane 
This expansion was discovered by Lambert (1728-1777). It is conver- 
gent on the whole complex plane except for two cuts along the imag- 
inary axis from —o i to —i, and from i to +i. This expansion 
is thus convergent in a far wider domain than the power series into 
which the function y = arc tan x may be expanded (this latter series 
is convergent inside the unit circle with centre at the origin). 

The terms of the partial quotients of fraction (5.40) satisfy condi- 
tions (5.14). We can thus obtain a further expansion of arctan x 
on the basis of equation (5.15): 


x8 9x? 4x? (2n+1)?x? — (2n)?x? 
3454+ 74+...4+ 4n4+1] + 4n4+3 +... 





arc tan x = x— 


x 
7. Expansion of the function y -| dt/(i+t*) as a 
continued fraction 0 


The differential equation for this function has the form 


‘ 1 ee 
y = Tax"? y(0) = 0. 
On putting 
ore 
y= THz 


the equation reduces to the form 


(1 + x*)xz' +(1 — x*)z 42? = xk. 
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This is the particular case of equation (5.35) whenz =a’ =B=y= 
=6= 1, p’ = ~1, k is any number. We therefore obtain, from 
expansion (5.36): 


+hk4+142kK+1+ 3k+1 +... 
nrk2xk (nk + 1)2x* 
wee Qnk +14 (Qn4+DE41 +...° 





f- dt = x xk kexk (K+ 1)*x* 
~T 
(5.41) 


This expansion was obtained by Lagrange. It is convergent on the 
plane of the complex variable x*, cut along the real axis from — 
to —1. When k = 1, expansion (5.41) becomes the expansion for 
In(i+x); when k = 2, it becomes the expansion for arc tan x. 


=z 
On substituting x?+1 for x in the integral | dt/(1+1#*) and setting 
0 
k(p+ 1) = q, we obtain from (5.41) the expansion 





= tPdt — xP*l (p+1)?xt q?x4 
o iti ptl+gtl+pt 2g+lipt... 
wePxt (nq +1+p)*x4 


—_—_———_ ‘i 5.42 
2... $2ng+1+pt+ (Qn+Dq+l+pt... 42) 


For example, 





std 1 9 16 49 l6r?_(4n +3) 

op ite 347 +1 + 15 +... + B43 4+ 8247 +...° 
O1 7 93° 1738 
13 30 378 71 


On using conditions (5.14) and equation (5.15), we can write (5.24) 
in the form 





= Pde xPti = xpttta (gq 4.1 + p)Pxt 
f. 141% p+l q+l+p+ 2q+1+p 
qrxt (nq +1+-p)?x? n?g?xa 
+ 3qt+l+p+...+ 2nqtit+p +(2n4+)g+le+pt...' 
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For example 


rd 1 1 49 16 (4n+3)? — 16n? 
pte” 8 74114 15 +...+ 8743 4+87474...° 
1 4 93 1459 
3 21 378 6006 


8. Expansion of tan x and tanh x as continued fractions 


The differential equation for y = tan x is of the form 
y=l+y, y0)=0. 
On putting y = x/(1+z), this equation reduces to 
xz'42+22 = —x?*, 
This is the particular case of (5.35) whena’ = Bf’ = 0,2 =B=y=1, 
6= —1, k =2. We thus obtain from expansion (5.36): 


x x xf x 
SA yas et op (5.43) 


This expansion was discovered by Lambert. It is convergent on the 
whole plane of the complex variable x, except for the points at which 
tan x becomes infinite. 

On replacing x by x/i in expansion (5.43) and multiplying the 
resulting equation by i, we obtain 
x? x 
ce ee oe eee Ge) 


9. Expansion of Prima’s function as a continued fraction 
The integral 
i f9-1 e-t dt (a> 0, x>0) 


x 


is known as Prima’s function. Let us introduce the function 


y = xinter | t2-le-t dy, 
x 
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which satisfies the differential equation 
xy’—(l-a+x)y = —x. 
On putting x = 1/t, y = 1/(1+4), this equation takes the form 
tu’ +[1—(1—a)t]u = (l—a)t, u(0) = 0. 
This is the particular case of equation (5.35) whena = 0,k =a’ = 


=B=y=1, ~ = —(1l—a), 6=1-a. We thus obtain from 
expansion (5.36): 


(l—a)t ¢t (-a)t nt (n+1—a)t 


I +1+ | +.0+1+ 1 +... 
On returning to the original notation, we get 


ao~X a 
Pastis gy ee, Ae 
x 1+ 








u= 





ae are ae eer G45) 


On contracting this expansion on the basis of formula (5.9), we get 
cn) - ao-x ‘ates = 
peti gy a Es e.g) 
- x+l—-a-—x+3-a—x+5-a-... 


n(n—a) 
1. — ¥+2n+1l—-a—... (5.46) 
We call [. (e'/t) dt the integral exponential function and denote it 


by Ei(x) (see (6.393)). We obtain from expansion (5.45) with a = 0 
and x <0: 


. 1 1 1 non 
=-efo— . mw —_—_ — 
a Ca oe a ee GA) 
The function 
; * dt 
Ei (in x) = » int 


is called the integral logarithm and is denoted by li(x) (see (6.394)). 
We obtain from ee (5.47): 


1 1 n n 
BS ete ns Seo 
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10. Expansion of the incomplete gamma function as a 
continued fraction 


To obtain an expansion of the incomplete gamma function, i.e. 


of the integral 


x 
| t9-le-t dt (a > 0), 
we introduce the function 


=x 
y= me | t°-le—! dt (x > 0), 


0 
which satisfies the differential equation 
xy'+(a—xy-1 = 0, WO=s. 
On putting y = 1/(a+y,) in this equation, we get 
XV, +(@4+x)i+¥ = —ax. 


This is the particular case of equation (5.35) when k = a = f’ = y=1, 
a’ = 0, B=a, 6 = —a, We thus have from expansion (5.36) 











0 —x 
ee xte ax x (1 +a)x 4 
4 a —l+a+2+a-— 3+a 
2x mx (a+n)x 
+4+a—...+2n+a—2n+ltat+... 


11. Thiele’s formula 


The Taylor series 
h U7 iz a h" (n) 
FR+A =MN+ATIO+GS OD + +5 PMO + 


corresponds in the theory of continued fractions to Thiele’s formula 


h h h 
Sle +h) TOF ae 4A © 3rre f(x) +... 
h 
wee bray f(x) + 0. 
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Here r,, f(x) is called the inverse derivative of the n-th order of the func- 
tion f(x). The inverse derivatives are defined by the relationships 


f(x) = ot refs) = fl) +2er,fO), 


and in general, for n = 2, 

trf(x) = Tn—oS(x) +0rry f(x). 
For example, 

re™ = e~*, ree* = —e*, ..., Fon e™ = (—1)"e*,_ 
Tonge = (— 1)" (2 + Ne. 
Hence 
(24+ l)rrppe* = (— 1)" (Qn 4+ De~*, 

(2n + 2)rrong ie = 2(— 1)"*1e*. 
If we use these relationships and replace x by 0 and fA by x in 
Thiele’s formula, we again arrive at expansion (5.39). 


Thus Thiele’s formula is another source of obtaining the expansions 
of various functions as corresponding continued fractions. 


12. Fractional approximations for sin x and sinh x 


The general form of the expansion as a continued fraction of sin x 
is not known. Only a finite set of partial quotients of the expansion 
can be found by Viskovatov’s method. For example, 





sinx = x # Tx? i? 551x? t 
1+ 6 — 10 + 98 —- 198 +... 
x 6x 60x—7x3  — 5880x — 620x3 
T Cee Geax? 3880436004 lial 
and 
sinx=x— * 3x? 11x% 25x? 
6 + 10 —- 42 + 66 —... 


x 6x— x 60x—7x3 2520x — 360x? + 11x5 
1 6 60 + 3x2 2520 + 60x? 
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It follows from the approximation 
sin xX = ——— 5.48 
60+ ( ) 


that sinz/4 ~ 0-7071, if we put 7/4 ~ 0-7854. Hence, in view of 
the periodicity of the function y = sinx and the relationships 


. {1 : ar 
sin ial =cosx and cosx = /1-—sin? x, the approximation 


(5.48) enables four-figure tables of this function to be evaluated with 
the aid of a calculating machine. In the same way, by using the higher- 
order convergents, we can evaluate tables of y = sin x with any num- 
ber of correct decimal places with the aid of a calculating machine. 

Since sinh x = ~—i sin ix, the expansions obtained for sin x lead 
us to the following expansions for sinh x: 


nen x x? Tx? 11x? 551x? 
~T—- 6 + 10 — - 98 + 198 —...° 


x 6x 60x—7x8 5880x + 620x3 


1 6—x? 60—3x?  5880—360x?+ 11x4 


and 


cae cos 3 3x2 lx? 5x2 
Te Se ee. AG? wick $2 266 idle? 
x 6x+x3 60x4+7x° 2520x + 360x? + 11x 

I 6 60—2x 2520 — 60x2 





13. Fractional approximations for cos x and cosh x 


The general form of the expansion as a continued fraction of cos x 
is unknown. Only a finite set of the partial quotients of the expansion 
can be obtained by Viskovatov’s method. For example, 
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cos x = ee = ae a se 
aes Ge cae 6 + 50 -— 1206+... 
1 2 12— 5x? 600 — 244x? 
1 2+x% 124x% 600+56x7+3x4 
and 
cosx = 1— = = oe esas 
7 2+ 6 = 10 +126—...° 
iL 2-x? 12—5x? 120—56x?+3x4 
1 2 12+ 120 + 4x2 


Since cosh x = cos ix, the above lead to the expansions: 


eae x 5xt 3x? 313x? 
ae ey ee ee 50 ao) 
a. 32 12+45x2 600 + 244x2 
1 2-x® 12—x% 600—56x?+ 3x4 
and ; 
cosh x = 1 x” x 3x 13% 
FE Eo ick ee Ade To a ee 
1 24+x2 1245x2120 4. 56x? + 3x4 
7 *=2 12—x? 120 — 4x2 


14. Fractional approximation for the error function 


The general form of the expansion as a continued fraction of the 
x 
error function erf x = (2//x) e~" dt is unknown. Only a finite 


0 
set of partial quotients of the expansion can be obtained by Visko- 
vatov’s method. For instance 


t ee ae x 39x? 73932 
) 


re 3 = 10 7 ee 94 Ae ta 


x 3x 30x— x3 210x + 110x3 
1 342x% 3049x? 2104+180x?+39x4 
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15. Conversion of Stirling’s series into a continued fraction 


Let us take the Stirling series (see (6.509) and (6.516)): 


InI(x) = (=-z)™ x-x45hn 22+ J(x), 


where 
_ B By Ban 
IO) Soe tags tot? GaSe 
and B,, B,, ... are Bernoulli numbers (see Chapter VI, § 2, sec. 1, 
15 


1 1 1 1 5 
By= | By = —%> B= => By = — 35> Bro = Eres 


By using Viskovatov’s method, we can convert the Stirling series 
into a continued fraction, the general partial quotient of which is 
unknown: 


In P(x) = (=-z) Ime x45 In 2a + 


AM 2 53, 1170 22999 
+12x+ 5x+42x+ 53x + 429x + ....° 


16. Fractional approximation for the gamma function 


If we evaluate the coefficients in the expansion of the gamma 
function: 


Ii+x) = au Cnx", 
n= 


1 2 S. 2] 
oGO=1, = ro (—1)¥ep_pSp, 5, = 2 ae (k = 2), 


5, = C = 0:57722 (Euler’s constant, see (6.56)), we obtain approxi- 
mately: 


I(1+x) + 1—0°57722x +.0°98906x?_ - 0°90748x3 +.0:98173x4— ... 
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On applying Viskovatov’s method to this approximation, we obtain 
in particular: 
rt4+8 = 1 +0°15141x +.0°24392x2 


T+O7263x—0324568 — 7) 6.49) 


This approximation is sufficiently accurate in many cases, as is 
clear from the following table: 





x | Pi1+x) | T(x) x I'(i+x) | T(x) 
—0°5 1-7725 17767 0-1 0:95135 0-95135 
-0-4 1-4892 1-4902 0-2 0-91817 0:91816 
-0:3 1-29806 1-29823 0:3 0°89747 0-89743 
0-2 1-16423 1-16425 0-4 0-88726 0-88711 
—0-1 1-06863 106863 0-5 0-8862 0-8858 

0 1 1 0-6 0-8935 0:8927 
0-7 0-9086 0-9071 
1 1 0-994 


17. Fractional approximation for the logarithm of the gamma function 


Approximation of this function on the basis of Stirling’s series 
requires a knowledge of In x. However, it is possible to obtain a 
simpler approximation by starting out from the expansion 


inT(1+x) = —Ox+ zo cor ao (5.50) 


where s,, = y 1/m", C is Euler’s constant. On evaluating the 
m=1 
coefficients, we obtain approximately: 


In F(1 +x) = —0°57722x + 0°82247x? — 0°400682x3 + 0°27058x4 — 
On applying Viskovatov’s method to this approximation, we obtain 
in particular: 


— 0°57722x + 0°59769x2 


InDU+%) © 7393g941x 013928 
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Hence 


— 0°25068x + 0°25957x? 


T403894ix—0- 139282 = 7) = 5.5) 


Ig (1+ x) = 


The accuracy of this approximation is clear from the table. 














x lg (+x) T(x) x Ig (1+) T(x) 
-05 0-2486 0-2469 0-1 1-97834 1-97834 
04 0-1730 0-1725 0-2 196292 1-96293 
0:3 0:11329 0-11321 0:3 7-95302 1-95305 
-0-2 0:066039 0:066029 0-4 1-94806 1-94818 
-0-1 0-0288268 | 0-0288266 || 0-5 1-9475 19479 

0 0 0 


18. Fractional approximation for the derivative of the 
logarithm of the gamma function 


In accordance with (5.50), the function 
Mx) = “mT +x) 
x)= ase +x 


has the expansion 
(x)= — C+ 5.x —Syx7 + 02. +(— 1) thy x" + «2, 
from which it follows that 
W(x) = —0°57722 + 1°64493x — 1:20206x? + 1:08232x3— .... 


On applying Viskovatov’s method to the last approximation, we 
obtain in particular: 


— 0°57722 + 1:25687x 


THOSTDBx—0 166702 = 7H): (5.52) 


W(x) = 


The accuracy of this approximation is clear from the table. 


CONTINUED FRACTIONS 285 





x | P(x) | T(x) x P(x) | T(x) 
—0°5 — 1-964 — 1-938 0-1 —0°4238 —0°4237 
—0-4 —1-541 ~ 1-538 0-2 —0°2889 —0-2890 
—0+3 —1-225 —1-218 0-3 —0°1692 —0:1687 
—0-2 —0-9650 —0-9647 0-4 —0:0614 —0:0600 
0-1 —0°7549 —0°7549 0-5 0-0365 0:0396 

0 —0-57722 —0,57722 


19. Obreshkow’s formula 


A knowledge of the general form of the partial quotients of the 
continued fraction into which a given function can be expanded is 
not sufficient for a determination of the general form of the conver- 
gent of this expansion. Nevertheless, the general form of the conver- 
gent can be found in certain cases. The most general approach to 
this problem uses Obreshkov’s formula, which is one of the general- 
izations of Taylor’s formula. Obreshkov’s formula is 


¥ (1 ek SOM pony = F a Sol porn 4 
ro) m+h 


v=o Ch m+k 


1 m k ¢(m+k+1) 
gat (x— 1)" (x) — OFF (t)dt. (5.53) 

Determination of the rational fraction approximations of a power 
function with the aid of Obreshkov’s formula. We put x» = 1, f(x) = x" 
in (5.53), m being any real number. Now, 


m CACE 

ie teen 
Fo y AGE @-iy 
pw x 


When m = k, this equation ne 


Pin a (x1) 


9=0 


~~ 


x" 
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In particular, when k = 1, 
ni 27ntnx 
xy 
n+(2—n)x 


For instance, when x = 2 and n = 1/3, we have /2 ~ 14/11 ~ 1-273 
(the accurate value is 1°2599. . .). 

Determination of the rational approximations of the exponential 
function with the aid of Obreshkov's formula. We put x, = 0, 
F(x) = & in (5.53). Now, 

we CR x” 


v=o Sint 2 


~ Py = 


v=o = +k ot 


In particular, when m = k, 


% 
4 





QK(W— 1)... (KWACHA) 2. (KAW 24 Cf Dem 2)... (lee ABH wt 





ie 2k(2k— 1)... (kh I) — CU 2k= 1)... (ke + CH 2k— 2), (kA DRIER (= Dx 
(5.54) 
Using the relationship 
et —]j 
tanhx = 
e+] 


together with (5.54), we get 
Ch(2k=1) (2k—2)... (ke 1) —C 8(2k—3) (2k 4). (KAN A+... 


tanh x = 3 
 RQKAM). oe Vet C2262) (23) (EE EES DRG) EB RE.., 


On replacing x by ix in the last equation and dividing the right-hand 
left-hand sides by i, we get the general expression for the convergents 
of the expansion of tan x as a continued fraction. 

Determination of the rational fraction approximations of the 
logarithmic function with the aid of Obreshkov’s formula, We put xo=1, 
J(x) = In x in (5.53). Now, 

- _ nr _Cm_ DB _ OIY” 
te 2 y Cth v +h Crnthk px” 








In particular, when m = k, 
La Or 4 1-2 (x-1)” 1 
Inxs > Cs, [‘- 1y-i+ ols = 


vel 





CONTINUED FRACTIONS 287 


For instance, when k = 1, 


When k = 2, 





§ 4. Matrix methods 


1. Extraction of the square root by means of second-order matrices 


The theory of continued fractions is built up with the aid of the 
fundamental recurrence relations (5.2). It seems natural to consider 
generalizations of continued fractions, based on other linear recurrence 
relations, connecting the numerators and denominators of neighbour- 
ing convergents. Let us consider in more detail the relations 


Py = %Pa_-1+BnQn-1» 


= 1, 2, eweese 5.5 
Q, = YnPn-1 + 5nQn-1» } Ms ) Go2) 


These equations can be written with the aid of matrices in the form 


Pr an Ba a) 
= = 15525 sces)s . 
&. e 5) he : e vy 


We put «4, =4,8,=u,7,=16,=a(n=1,2,...). Relations 
(5.55) and (5.56) now become respectively 
Py = aPy_y+uQn_y 
Qn, = Pa-1t+4Qn-1 


Pra _ (4 4 Pay _ 
is) = ({ ;) co (n = 1, 2,...). (5.58) 


When a = 0, the process (5.57) is divergent. We shall therefore 


assume that a = 0. If lim P,/Q,, exists, it can be equal either to Ju 
n—-> oo 


} (n= 1, 2,...) (5.57) 


and 
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orto — Vu. Consequently the process (5.57) is divergent when a < 0. 
Let us use the notation 


—vVu = xX, Ju = XQ. 


We now have four cases: 


P. 
1) a> X» Xy<~< net 
: Qn Qn-1’ 


2) O< a < %; 


Ponsgi a Pon—1 : 


Qon+1 Qon -1 : 


Pon-e _ Pan 
————— < 
Qon—2 Qon 


3) x, <a~<0, 


<= X%y< 


ae coe 





Pon— P 
anna. Santi yg 22 : 23. | ph 
Qen-1 Daina Qen Qon-2 lim —* = x. 
n-—->ocokn 
4) a<x. Has Te eg, 
1» 1> 
On-1 n 


For example: 


1) a> Xp, 
G3:¢¢ 2 
1 5) 1 10 97 940 
5 4-7 4-6907 4-69043 
J/22 < 469043; 
2) O<a<x, 


1 10° 5 SI 520° 260 
5 52 519607  5-19616 
519607 < ./27 < 5-19616; 


€ 3) 5 52 26 265 = 2702 _ 1351 


3) x,<a<0, 


-~1 2\ -1 3 ~7 17 —41 
Lay 4 2 5 —12 29 


—1 -15 -1:4 -1:416 —1-4137 
- 1416 < —,/2 < —1-4138; 
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4) a<m, 
€ ;) ee Oe 
1 —-2/ 1 <=4 15 — 56 
—2 —1-75 —1-734 —1-73214 
—1-73214 < —/3. 


2. Solution of quadratic equations with the aid of 
second-order matrices 


Let us put a, = a, 8, = —4, Yn = 1, 6, = at+p in (5.55). Relation- 
ships (5.55) and (5.56) now become 


P, = aPy_1— qQn-1 } 
Qn = n-it(@+P)Qn-1 


(c,) = (4p) (or) Gp 
Qn latp/]\Qn-1 
If lim P,/Q, exists, it can only be a root of the quadratic equation 


n—>eo 
x24 px+q = 0. Consequently, when p?—4g < 0, the process (5.59) 
is divergent, since the roots of the quadratic equation are complex 
in this case, while a sequence with real terms cannot have a complex 
limit. 

Let us write 


_=e- VP, - pt VFA 
= 2 ia 2 7 


(5.59) 
and 


xy 


When a = state) the process (5.59) is divergent. When the pro- 


cess is convergent, we have four cases: 


Pre 
1) a> xX, X%y<ptx tl; 
Qn Qn-1 
XK. 
2) => 2 <a <X,, lim — = x; 
nl—->co nr 
Poxe P P Pays 
amma Pon Ponta _ Pana. 
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xXy+x 
3) xiy<a< - 2 
2 
Pope P. P. Pon aul, 
Paawt Pantry cPin Pama (tm Poy, 
Qon-1 Qon+1 Qon Qon—2 


N->cokn 





For instance, the equation 


x? + 2x-—-1=0 
has the roots 


Me=-liJ2 or 42-2414 and x, x 0-414, 


1) a> Xp, 


Pee an Cake ee ee eae cee 
er ae) We ce i eT a 
1 


05 043 0-417 


2) AE <a<n 
2¢: (2 )\2-2. 2 & 
SNe Nae PT ge a 
0 05 0-40 0-417 
3) xy<a< i +e 
2 
singe [re ayes So SR 
Sexes 0) 4° <3 5 ar Ole 
—2 -25 ~240 -—2-416 
4.a< x, 
ye fae. eS: 10 Oe | 
Ge Ae te waa as. 9 ee 


-—3 — 2°55 — 2-428 — 2-416 
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3. The connection between matrix methods and the theory of 
continued fractions 


Let us find the conditions under which the equations (5.55) can turn 
into equations (5.2). For this, we replace n by n—1 in equations 
(5.55), find Q,_, and P,_, from the relationships obtained, and 
substitute them in equations (5.55). On introducing, for brevity, the 
notation ,_, 9,,—Br-iYn-1 = An-» We get 





+. Prd n-1 B,4 n=-1 
Rite («+ ian Pe) Pyaa SOP. (S61) 





| . 
Qn = (3 tnat +8n) Quai" Ona (5.62) 


n-1 Yn-1 


Equations (5.61) and (5.62) show that P, and Q, can be taken as 
the numerator and denominator of the nth order convergent of a 
continued fraction provided that 


Yn 
Ya-1 














On + on = + bn-1+%n; a 2 (n = 2). 
n— n= 


These conditions are readily written in the form 








on — On = On—1— On-1 oS ee a, — by 

Bn Bn=1 By (5.63) 

Bn _ Poa _ aes ete 

Yn Yn-1 V1 
Hence the matrix 
ny Bn 

— 646 5.64 
Ben ln ar + Ba ( ) 


is equivalent to a continued fraction, the partial numerators a, and 
partial denominators 5, of which are given by the equations 


a, = Bn Bn —Yn—1— On—19n-1)) on = Png, +Qn_1 (n= 2). 
Baa Bn—1 


292 MATHEMATICAL ANALYSIS 


We can find from the relationships 


Gayle ee 
Coe a) 


the zero and first partial quotients of the fraction. Hence the matrix 


and 


(5.64), in conjunction with the matrix & :) , leads to the continued 
0 
fraction 


Bo 

= (By, —%46. 
ie % 1% q + By — Xo(V1%q + 61) By ra M194) 
a _ FO??? 





—6 
V1%o — 91 + e dj+a, +... 
Bn as 
B (Bn-1¥a-1 — %n—-19n-1) 
aor ee tacaaes (5.65) 
eee t Boni + On + eee 
n= 


EXAMPLE 20. The matrix (; ‘) leads to V2 and is equivalent to 


the continued fraction 


1 1 1 
2=14+- = = j 
ee anee ee 
In the theory of continued fractions, contraction is performed with 
the aid of the fairly complicated formula (5.9) and analogous formu- 
lae. Here, it is performed much more easily, with the aid of squaring, 
cubing, etc., the matrix. We have: 


1 12 3 4 
2 = A a, = 2-4-3-3= —-], 
1 1/\1 1 2 3 


bp =34+3=6 (nz=2). 


The zero and first partial quotient of the new continued fraction have 
to be found directly, and not on the basis of this matrix, from a 


knowledge of the first convergents of the initial expansion for af 2 
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We get 


2 1 1 
Tesco eer eee 


On using the cube of the initial matrix, we get 
3 4\/1 2 7 10 
pee 9 2 tas We a eo a 


J/2 = 14 _ a 
7 124144 144+ ...° 


4. The reduction of quadratic surds to non-periodic continued fractions 
by means of second-order matrices with variable elements 


The results of the previous section enable us to obtain as many 
expansions as desired of irrational square roots as non-periodic 
continued fractions. 

EXAMPLE 21. The matrix 


(1 2@+)) 
Ge 1 ) 


satisfies conditions (5.63). In addition, it leads to the equation 
Pr = Pai t+2(n+VYQn-1 
Qn (n+1)Pn-1t+Qn-1 ’ 
from which it follows that lim P,/Q, = 2. The equivalent continued 


n—> co 


fraction (5.65) has the form 
Jr ai42 21 B17 1531 24.49 


S+54+ 7+ 9 4+ TF +45. 
(n? ~— 1) (2n? — 1) 
eee t+ 2n+1 +..." 
Similarly, by starting from the matrix 


n 22(n +1) 
oa n ) 


we get the continued fraction 


eat Oe (n? — 1) (9? + 2n—1) 
aaa Ue tay Jee Seen 2n? —1 Sek ee 
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5. Extraction of the root of any rational power by means of matrices 


Extraction of the cubic root with the aid of matrices. Let us consider 
the three sequences {P,}, {Q,}, {R,}, the terms of which are connected 


by the relationships: 
Py = GPp-y+tQn_1 + tRn-1, 
On = Pair tQQn-1+tRn—1, (n=1,2,...). (5.66) 
R, = Par +Qn-1 +aRy_1 


These relationships may be written with the aid of matrices as 


Pr at t){Prh-1 
Qnf=]1 @ t) |Qn-a (5.67) 
Rn 1 1 a) \Rp-y 
Let x = lim P/Q, and y = lim Q,/R, exist and be finite. Now, 
N—> oo n> co 


xa, ya Yi. 


EXAMPLE 22. Let a = 1, t = 2. Then 


122 1 5 19 73 281 1081 
112 1 4 15 58 223 858 
111 1 3 12 46 177 681 


8/4 approximately 1 1°67 1°583 1-5870 1-58757 1-58737 
2 approximately 1 1-33 1-250 1-2609 1-25989 1-259912 


It is well known that /2 ~ 1:2599210, \/4 = 1:5874011. 

By utilizing the square, cube or a higher power of the initial matrix, 
the convergence of the process can be strengthened as desired. 

Extraction of the fourth root with the aid of matrices. We generalize 
relationships (5.66) and consider the following equations: 


On = Par taQn-1t+tRn—ittSn_1, (n = 1, 2, ...). 
Ry = Paoit Qn—1+@Rn-1 + tSn—1 | _ 
Sp = Pay +Qn-1+ Ra-1 t+ GSn—1- 


Pp = OPy_yt+tQn_1 + tRa_-1 + tSy_1, | 


We can write these with the aid of matrices as: 
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Pr att t\ (Pry 
Qn) _{1 @ t t}{Qn-y 
Ra 1 1 a tj}{ Ray 
Sn 141 bay XSe., 
Now, 
tim aa $/8, jim =f = 7, tim 4, 
n—>0o Sn N—> oo Sn Np Dn 


if these limits exist and are finite. When a = 1, we have the matrix 


1 ¢ ¢ ¢\ 1 143t 1412¢4+32? 14312431240 
1 1¢ ¢t) 1 242¢ 34+12t+2 44 40t +2072 
111¢]) 1 34t 6+ 10r 10 +442 + 1022 
1iit/t 4 10+6¢ 20 + 40¢ +. 422. 


Hence we can obtain in particular the inequalities 


224.12t+3 aps 612 + 10t 


67410 Paiags Sts %) 
60? +108 © 127412143 
Paluds = sJis—ip ¢ =). 


The domain in which we can apply these approximations is clear 
from the following table: 











2412¢43 6t? +10¢ 
f 6t+10 ve 41243 
1 1-000 1-000 1-000 
2 1-409 1-414 1-419 
3 1-714 1-732 1-750 
4 1-971 2-000 2-030 
5 2:200 2-236 2:273 
6 2-413 2-449 2-486 
1 2-615 2-646 2-676 
8 2:810 2-828 2-847 
9 3-000 3-000 3-000 
10 3-186 3-162 3+139 
11 3-368 3-317 3-266 
12 3-549 3-464 3-381 
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Extraction of any rational root with the aid of matrices. It may be 


seen, on generalizing the method above described, that the mth-order 
square matrix 


eo eo we ew we 


enables approximate values to be obtained for 


For example, to evaluate Va, we only need to carry out the fol- 
lowing working: 


122 2 2 2 2) 1 «#13 = #127 
1102 2.2 2-2) 1 12 115 
1112 2 2 2] 1 «211 «#104 
111121 2 2 2) 1 «10 «94 
112121222 2) 1 ~=«=9— 8 
1 11,1 1 1 2] 1 8 #77 
1112121221 13) 1 °=7 «27 


In particular, 9/4 ~ 104/85 = 1-223 or /4 ~ 85/70 = 1-214. The 
accurate value of this root is 1219... . 

The convergence of Euler’s algorithm. The method of extraction of 
roots of any rational degree with the aid of matrices was first pro- 
posed by Euler (though not in matrix form). The conditions for its 
convergence were recently obtained by L. D. Eskin. In particular, he 
showed that Euler’s algorithm is convergent for any t> 0 provided 
only that the zero approximation be chosen by a reliable method. 
Furthermore, Euler’s algorithm is convergent for complex t, which 
enables it to be used for approximate extraction ofroots of complex 
numbers. 
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6. Solution of cubic equations by means of matrices 


The matrix 
4, 2 Ay 
41 92 423 (5.68) 
931 43g 433 
eads to the equations 
= WMI 4% ang y = MEETS 5 69) 
1X + soy + O33 431X + As2y + Ag3 


On eliminating x from these equations, we arrive at a third degree 
equation in y. Consequently, the matrix (5.68) can serve, when the 
corresponding process is convergent, for approximate evaluation of 
one of the roots of a third degree equation. 

We can readily obtain from (5.69) the equations 


oe | 4 Gar = 931)% + (Gag = Asa) + a3 — 233 
A3)X + Aga) + Ags , 


(44 — Gg1)X + (412 — Gn2)Y + 213 — og 
Qg1X + As + G39 


y 
x=y+ 


Let us require that the condition y? = x be satisfied. For this, it is 
sufficient that the equations obtained take the form 


Aq3 ~~ A33 (dy — @35)y 
= 14-33 og ee yy 
* + Q31X + As2y + Gag hema Ag1X + gay + G33 
Now, 


Go, = 431, Ang = Azn, yy = 9}, 3 = Ag, 
412 — Gzq = Gog — Ag. 
Matrix (5.68) takes the form 
Gy, Fy9+Ay3— G33 Ay 
ay, G22 3} . (5.70) 
ay 22 Ag 


It leads to the equation 


Ay? + (Gra — 211)? + (gg — Gag) — O43 = 0. (5.71) 
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Let us put, in particular, a,, = do. = 1 and let us write a,,—1 = p, 
a3 = —q. The matrix (5.70) takes the form 

1 =Pag --@ 

1 1 =—q)|. (5.72) 

1 1 pti 
It leads to the equation 

Ytpy+q=0. 

When p = 0, g=—t, the matrix (5.72) becomes the matrix for extract- 
ing the cube root. 


EXAMPLE 23, Let us apply matrix (5.72) for obtaining approximately 
one of the roots of the equation x*— x—1 = 0. We have 


12 1) 1 4 12 37 114-351 1081 
1141 3 9 28 86 265 816 
1 1 0) 1 2 a 21 65 200 616 

1 1-5) 1-285 1:333) 1-292 1325 1-324 


Notice that the convergence of this method is only rapid when 
the equation does not possess two roots close to one another in abso- 
lute value. 


7. Recurrent series. The Bernoulli—Euler method 


oo 

A power series }' a,x”, the coefficients of which, as from a certain 
n=0 

n, are connected by the same linear relationship, is described as recur- 


rent. The following theorem holds: the necessary and sufficient condition 
for the sum of the series ¥° a,x", convergent for |x| < 1, to be a rational 
n=O 


function of x is that the series be recurrent. 

D. Bernoulli and Euler applied recurrent series to the solution of 
algebraic equations. Cauchy provided the basis of the method by 
indicating that, if x, is the root of least absolute value of the polynom- 
ia] Q(x), the radius of convergence of the series 


PO) 
Eo" = Gay 
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where P(x) is a polynomial having no roots in common with Q(x), 
and the degree of which does not exceed the degree of Q(x), is given 
in accordance with d’Alembert’s test by the relationship 


ta Gn41%1 _ 1 
n~> co an 


from which it follows that 


an 





x, = lim 
neo Any} 


For instance, Euler solved the equation x*—3x+1 = 0 by using 
the following expansion: 


1 


Reeder 54 5 
oar 1 + 3x + 9x? + 26x93 + 75x4 + 216x5 + 


+ 622x® + 1791x? + 5157x® + 14849x® + 


+42756x +... = x a,x". 


n=0 
Here x, = ch a Onl On +p Where x, is the root of least absolute value 


of the equation x3—3x+1 = 0. The convergence of the process is 
clear from the following table: 





NAAN WN 
° 
5 
~“ 


0-347292 


On replacing x by 1/x, the same method can be used to find approxi- 
mately the root of greatest absolute value of the equation Q(x ) = 0. 
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The convergence of the Bernoulli-Euler method is also only rapid 
when the equation does not have two roots close to one another in 
absolute value. 


8. Connection between the Bernoulli—Euler method and matrix methods 


Let us find by the Bernoulli-Euler method the root of least absolute 
value of the equation x°+ px+gq = 0. For this, it is sufficient to expand 
1/(¢+px+x*) as a recurrent series. We have 


1 
Gipxe = Apt Ayx+Agx*+.... 
On equating coefficients of powers of x, we get 
1 
Ay = 7’ gA,+pAyp=0, gAp+pA,=0. gA3+pA3+Ao = 0. 


and in the general case: 
9An+PAn-1+An-3 = (n = 3). 
This relationship can be written as the matrix equation: 


0 q 0) (An-s gAn—o 
0.0 9| | An-2} = | GAn-a 
—1 0 =p) \An-1 gA, 
But this equation gives only one new coefficient A,, while the two 


preceding ones are repeated. Ontaking the cube of the matrix com- 
posed of the coefficients, we at once obtain three new coefficients: 


A 0) os 
Pass = ie > 
es , = q FAnte 

g 0 pq Ans PA, 


—pq @ —p'g | |An-2| =|] 9? 4Angi 
BP —pq pi+q*) \An-y 93An+e2 
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On applying this method to the equation x*—3x—1 = 0, we get 


-1 0 3) 1 26 622 = 14849 
—3 -1 9} 3 75 1791 42756. 
—9 -~-3 26) 9 216 5157 123111 


An even higher power of the initial matrix can be taken; this still 
further strengthens the convergence, though not all the coefficients of 
the recurrent series are utilized in this case. The elements of the matri- 
ces obtained can be divided by the same number, since we only need 
the ratios of neighbouring coefficients. But the series obtained here 
will in general differ from the recurrent series, into which 1/(¢+px+x*) 
is expanded. 

On replacing x by 1/x, the same method can be used to evaluate the 
root of greatest absolute value of the equation x°+px+q= 0 (if 
the corresponding process is convergent). 


9. Solution of higher degree equations by means of matrices 


We can use a method similar to the above to form nth-order 
matrices that can be employed for the approximate evaluation of 
the roots of an nth-degree equation. For example, the matrix 


k la, 0 ... O 0 0 0 0 
0 k la, 0 0 0 0 0 
0 0 oO lay, 0 0 0 0 
0 0 0 k lan 0 0 0 
0 0 0 0 k la, 0 0 
0 0 oO. 0 0 k 0 lap, 
—lay —la, —lag... —lan_s —la,_y —ldn_y kK—la,_, —lan_, 
0 0." Orage 0 0 lap, k 


can serve, when the corresponding process is convergent, for approxi- 
mate evaluation of one of the roots of the equation 


AnX” + dn x" 1 + 01. +a,X+ady = 0. 
For example, in the case of the equation 


xt— 8x34 x22—x+1 = 0, 
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we obtain on putting k =] = 1: 


110 0, 1@Q1 2 4 11 38 455 
010 31} 1@)1 2 7 47 397 =. 3500 
—1 19 —1} 1 (8) 4 35 310 2753 24463 217403 
001 lV 1@)1 5 40 350 3103 27566 
1 4 7 7-75 7-866 17-8837 7-8866 


The exact value of this root is 7°8873... . 


10. The idea behind Jacobi’s algorithm 


Euler posed and partially solved the problem of finding the solution 
in integers of the equation «,x,+2%_+3x3 = 0. Jacobi posed the 
analogous problem for the equation 
Ay Xy +A%QXq + eee +2nXyn = 0 
and developed for this purpose a special algorithm, which is a gener- 
alization of the algorithm of continued fractions. In particular, Jacobi 
assigned to this algorithm the following form: 
Un+1 = Va-Prtns 
Yn41 = Wn— Grrr 
Wn41 = Un- 
Here, p, and g, are positive integers, chosen in such a way that 
Uns, and y,,, are the least possible positive numbers. With the aid 
of the numbers p, and q,, we form the following relationships: 


An = GnAn—1 +PrAn-2 t+ An-sa; 


(5.73) 


By = QnBn-1+PnBn-2+Bn-s> 
Ch = GnCn—1 +PnrCn—2 + Crs 
We suppose that 


(5.74) 








AL, A_y Ao 1 0 0 
B_, By Bj =l]0 1 O}.- 
Ci, Ci Cy 00 1 

In this case, when Jacobi’s algorithm is convergent, 
A, uy B Vy 


lm = = —, lim =~ =—. 
n—>co ln Wy, neo Cy Wy 
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Jacobi’s algorithm enables us to find fairly small integers 4,, B,, 
C,, approximately proportional to the given large numbers 1, ¥,, W,. 
EXAMPLE 24. Let us solve approximately the equation 


xiyizs 49:59:75, 


We have, on using Jacobi’s algorithm, 


nN Un Yn Wn Pn Gn An Bn Cy 

-2 1 0 0 

-1 0 1 0 
0 0 0 1 
149 59 75 1 2 1 #21 «21 
2 10 26 49 2 4 4 5 6 
3 6 9 10 1 1 5 6 8 
43 4 6 1 2 15 18 23 
5 1 0 3 0 3 49 59 75 
6 0 0 1 


Thus, for example, 5: 6: 8 ~ 15: 18: 23 = 49: 59: 75. 

The order of filling up this table is as follows: we first evaluate 
u,=49, vy, =59, w,=75 and 4,, B,, C,, with n= —2, —1, 0. Next, in 
accordance with algorithm (5.73), we evaluate p,, q1, Ua, Va, Wa. Then, 
with the aid of relations (5.74), we evaluate 4,, B,, C,. Next, in accord- 
ance with algorithm (5.73), we evaluate pa, qa, Us, V3, W3. With the aid 
of relationship (5.74), we evaluate A,, B,, C,, and so on. 


CHAPTER VI 


SOME SPECIAL CONSTANTS 
AND FUNCTIONS 


THE present chapter contains information on real constants and 
some real functions commonly encountered in analysis.t 

Our treatment must take into account the fact that differing defi- 
nitions are current in mathematical literature. For instance, the 
generating function of a sequence of functions is usually defined as 
the function of two variables f(x, y) for which the relationship 


fx, y) => nlx)", 


is satisfied in some domain of the x, y plane, i.e. the ,(x) are the 
coefficients of the expansion of f(x, y) as a series in powers of y (cf. 
the definitions of the generating functions of Bessel functions and 
Legendre polynomials). In other cases, f(x, y) is called the generating 
function of a sequence if 


f(x,y) = pias Pf). 


(cf. the definitions of the generating functions of Bernoulli and Euler 
polynomials). 

There is also a lack of uniformity as regards the notation for 
various functions. In such cases the different notations will be quoted, 
though only one of them will be utilized. 


t Information concerning functions of a complex variable will be given in a 
later volume. 
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§ 1. Various constants and expressions 


1. Some well-known constants 


1°. The number a: x = 3°14159 26535 89793... 

The number z made its appearance in connection with the caicula- 
tion of the length of a circumference by finding successively the 
perimeters of the inscribed and circumscribed regular polygons with 
2" sides. a is a transcendental number. 

Some approximations for the value of z: 


mw = 22/7 (Archimedes? number); 
w = 355/113 (Metsiev’s number). 


Some representations of 7 as series and products. On putting x= 1 in 
the power series expansion of arc tan x, we get the Leibniz series 


mu 1 1 1 ee 
qlee g reat eee ey Seay ee (6.1) 


With x = 1/V. 3, we get from the same expansion 


bf 1 11 11 141 

ie agate ea gt .). (6.2) 
Since 7 = 16 arctan (1/5) —4 arctan (1/239) (Machin’s formula), 
we have 


1 1 1 
-4(a9-3 at --): (6.3) 


Wallis’s formula is 
mT. (2n)!! 2 4 
2 = im | aot a | tat1" om 
As a continued fraction: 


12 
T+3 + 


n 
oe t2n+1+. 


— 





2 
+. (6.5) 
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Other relationships are: 








nu 1 
—= Y arctan —,. 
a= 2 oe 
Fd hod 1 
a ee anal 
a Soe 
8 2 Gas DGit3): 
nm 2 (— yr = * Emaz | 6(—1)"Eom 
ra er +(-1)" p> Cony +— Gym ae 
O<6<1. 
2n 2 1 





mae amy tat 


m(—1)-1By-2 1 &: G—1)™ Bemse 
Ra Qrt=1_ 2u—1 ' Q)"4l Im+1- 
2 2 2 


RI aEYR 


2 
—= Tl cos ——— 

n+1° 
tS 7 


nm 39 1 1 1 
Fo * jot pase tage tag t 








Ws 
2 





m1 eo ok 
Bai aes 7 


(6.6) 


(6.7) 


(6.8) 


(6.9) 


(6.10) 


(6.11) 


" (6.12) 


(6.13) 


. (6.14) 


(6.15) 


(6.16) 


(6.17) 


(6.18) 
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32 1 


— = [-2 > pt (6.19) 
32 2 GF 
Eg 1 1 1 1 
{6 att pe tate s20) 
3n2 1 1 | 1 
356 = ott et et +. (2D 


Inequalities connected with the number x. If a,=0 (n=1, 2, ...), 
but not all are zero, we have 


co 4 °o co 
(z an) sv yay wai, (6.22) 
n=l n=l n=l 

a? being the best constant in the sense that there exists a sequence a, 
for which equality is attained. If f(x) = 0, f(x) #0, fEL?(0, ~), 
xf €L, (0, -), we have 


4 
i f(x)dx} = a) [- f(x) | [renee , (6.23) 
9 | 0 | 0 





where 7? is the best constant in the sense that there exist f(x) for 
which equality is attained. 


Integral forms of x: 








a °° tan x 
7 es | zs dx. (6.24) 
0 
1X e° sin x cos mx 
Cie i. coeur ae dx, m < 1. (6.25) 
cay esa, (6.26) 
z= : 2 Ix. (6. 


$ jz = i sin (x?) dx = i nee (x?) dx. (6.27) 
0 t) 
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2°. The number e: 
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[E- "eran | cosx 


ae = | e-*dx, 


tt) 








12 x 


e = 2-7182818284 59045... 


Euler’s number e is defined as the limit 


e= lim 
Nh—> co 


e is a transcendental number. 


Z|. In (1 +x) dx 
0 


1\" a 
(142) = mare? 
n a—>0 


(6.28) 


(6.29) 


(6.30) 


(6.31) 


(6.32) 


(6.33) 


(6.34) 


(6.35) 


(6.36) 
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Expressions for e, e?, e~1, (1+)? as series and products: 


m+(m—1 
Pm+1 = 1+mp,+ me nD yt oe $Pm; 


n= 1, P2 


~ 


1 


a Z 


_ 2/4\? /68\4* / 10.12.14.16 \8 
or gg 5.7 9.11.13.15 

t+yeR=¥ 

n=0 


+2 (OCG C) 








2e-? = lim fel 
Dane — atk 
Riess @) 
Jd, eee tee 
+64+104...+ 22Qn+1) +... 


(continued fraction). 
Some inequalities. When 0 = t Sn: 


2, py=5, py=15, ps=52,.... 


309 


(6.37) 


(6.38) 


(6.39) 


(6.40) 


(6.41) 


(6.42) 


(6.43) 


(6.44) 


(6.45) 


(6.46) 


(6.47) 


(6.48) 
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When u,, > 0: 
n 2 
Ox 1-# (1-5) 2-. (6.49) 
3 Vine Un 
“ol _______ se. (6.50) 
Lun 
n=l 
lim sup 27 Mat ze. (6.51) 
N=—> co Un 
Minima: 
: min =e 1, (6.52) 
Sx<oo 
(Zit py =e, (6.53) 


The number e is the base of logarithms with which the inequality 


is satisfied: 
log ax = x—1 (Ostrogradskii). (6.54) 


The functions e* and e~* are defined as the limits 


e == lim (+2), e-* = lim (1-3Y- (6.55) 


nN—> co n—> co 
3°. The Euler—Mascheroni constant C: 
C = 0-5772156649 015325... 


The Euler—Mascheroni constant C is defined as the limit 


m—>eoo\n=l 


@= "tm (z -- nm) (6.56) 


the existence of which follows from the convergence of the series with 


general term 
nN+1 


g(n) = — t71 dt. 
n 


It is unknown whether C is rational or irrational. 
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Integral forms. Since 


1 | Soe are nae al ee 
lt+y+ +. tee [ere [Lt (3 =) P dy 


and 





we have 


m | 1 y\")]- ‘m y \% 

—-—-Inm= 1-( 1-— ~Idy — 1-—-— ~1g; 
pee Ee) Poe) ee 
from which we find, on passing to the limit, that 


C= I. (1—e-¥)y—? dy — | “e-uy-2 dy (6.57) 
0 


1 


1 
C= iF (1 —e-t— | t71 dt. (6.58) 
0 


It follows from (6.58) that 


or 








C= | “Ul —e-)-2—r-Me-t dt, (6.59) 
0 
Other integral forms. 
CLs | "ent In t dt. (6.60) 
0 
C5. ee a. (6.61) 
>| mt it . 

- 1 \ at 
C= =f (cos « - rar) S (6.62) 

- / sin t 1 dt 
Cats : (- crane (6.63) 





t 
‘ee ie  emrem id (6.64) 
- Jo \ +e t , 
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2 1 dt 
= —~ ~—e-? j— 
Cc ie (ae e ) e (6.65) 
so 1 cos t 
C= I. (an) dt. (6.66) 
1 1 
=~ ( In In >. (6.67) 
dt 
C= ia (z arc cot t—e om) Fin p. (6.68) 
2 
C= i (3 arccotf—cos pt dt Dp. (6.69) 
0 
C= —F [sina (6.70) 
mI, t 


The asymptotic expansion is 


oo ee 
a 120m* °° 


By, 1 46 Bons2 1 
2n men 2n-+2 mnt2? 














wet 0<96<1. (6.71) 


Infinite products expressible in terms of e and C are: 





z + AC ++i. i +5-In m)-+in m 
qT] — = lim ™ 1 
Z j me = 
se H(1+3) 
20 in at =e, (6.72) 
™M—> co 
(+7) 
1 
t 2 ras 1 


(6.73) 
4°, Catalan’s constant G: 


G = 0-91596 55941 772190.... 
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Catalan’s constant G is defined as the number 
1 
Ge | panied ates (6.74) 
je oe 


An expression for Catalan’s constant as a series can be obtained 
by expanding x7? arc tan x in (6.74) as a power series: 


06 Im 





=) ~——,;. 6.75 
o es (2m + 1)? er 
Other integral forms are: 
1/2 
gare. (6.76) 
2}, sint 
fd m4 
G= Fin242 | ttan ¢t dt. (6.77) 
0 
Ed m4 
G= ~Fin2+2/ t cot t dt. (6.78) 
0 
bg 7/2 tat 
£G= ogee » (cos t+sin ¢) sin t* 62) 
nm m4 tat 
c= oo aor > (Sin t+cos t) sin t* 880) 
nm re 
G= -Z In 2-2 In sin t dt. (6.81) 
0 
a /4 
G= 3 In 242] In cos ¢ dt. (6.82) 
0 
1 (le nm 
+G= a in (1+cos t) dt+ oa In 2. (6.83) 
0 
2/2 n 
G= | In (1 + tan ¢) dt—-F In 2. (6.84) 
0 
1 Int 
= ee Ts dt. (6.85) 
Jt 
Ga Sing | te (6.86) 
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c= [ma+oSa-F = m2, (6.87) 
_ 2 In (1+12) 
G= =F n2-7[ Jin? dt. (6.88) 
_2 11n (1 —t) 
Ge= 7 in2—[" is? dt. (6.89) 
1+t dt 
G ' i ioe (6.90) 
32 1 1+? dt 
G = —In2 - a "her Tee (6.91) 
bf 1 arc cos t 
G= t7n2+5 Shee (6.92) 
- arc cot t 1% 
Ge : “Tz, UF Gn (6.93) 
1 arc tan t n 
= dt Zin ; 6.94 
G= {cen + 2 (6.94) 
Ge a: ee i. (6.95) 
> i-t 
= gina+ |’ (Z—arotans) (6.96) 
, I=? 
Gao ( 2eawanr eee: eH 
wel ed lorie a : 
wm 1 fe 2 at 
Ge= Tera], (arc tan : PJIte (6.98) 
od , tat 
G=— 16 ae (arc cot fr) Tire (6.99) 


Expressions in terms of complete elliptic integrals (see (6.380) and 
(6.381)): 


Gz > } * K(k) dk. (6.100) 
0 


Gz } * E(k) dk — 1. (6.101) 
0 
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2. Soumne merical expressions 
1°. Factorials. When n is a positive integer: 


= 1.2.3...1 (6.102) 
By definition, 
Ol=1. 


The gamma function is a generalization of the factorial (see § 4, 
sec. 5). 
When is a positive integer: 


(2m)!! = 2.4.6... 2m. (6.103) 
(Q2m+1)!! = 1.3.5...(2m+1). (6.104) 
(2m)! = 2™m!(2m—1)!! (6.105) 


The number n!! is called the double factorial of n. Expressions for 
factorials, inverse factorials and their sums: 


= 1 


Me 








nn! 2 m(m+1)...(m+n) ° a5:108) 

n 
(n+1)! = L+ 2, kk! (6.107) 

ml 

co =] ete-1 

Dap = Tp = cos L = 154308... (6.108) 
ee mde ae inh 1 = 1+175201 6.109 
“Oat 2. ee epee 
5 ee a coe ene sdoan 6.110 
ey Dn! = cos] = ee (6.110) 


23 (—1)"-1 aor yy = sin 1 = 084147... .111) 


x nie = I,(2) = 2:27958530.... (6.112) 
n=l t 


be 1 


Pe emye = 1,(2) = 1-590636855.... (6.113) 
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— 1 


Z,alapber = Fa): (6.114) 
sor = Jo(2)=0-22389078 .... (6.115) 
Dy art = J,(2) = 0:57672481.... (6.116) 
3 aso = J,(2). (6.117) 


Inequalities and asymptotic formulae: 


[Eeva(2) <nl<eJ/n (2) (6.118) 


“ee (zy’ (6.119) 


oy ag (6.120) 


n 1 Fons 
A ee (Z) (+t -) (Stirling). (6.121) 
On 
(2n—1)!! = JZ(2n)"e "738", 10,] < 1. (6.122) 
1 
n+— 


2 
ES 0 
ni= Jon ea 24n+12 (Gauss). (6.123) 


A formula for the logarithm as a factorial: 


In n! = Yn P ( [F| rs | + | fie ), (6.124) 


where the summation is over all primes p not exceeding n. ( [x] is the 
integral part of x. See § 3, sec. 1, 3°.) 

Divisors of a factorial. The greatest index with which a prime p ap- 
pears as a factor in n! is 


F] + E Speeds | (6.125) 


R+1 


where p* = n, but p**2>n. 
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For example, the highest power of the number 2 by which 50! is 
divisible is 
50 50 50 50 50 
aeducausaelaes 


Thus 50! is divisible by 24’. 
2°. The Kronecker delta 67° (or 46,,,) is defined by 


llnrz=m 
6m = i” 6.126 
= i nm. ¢ ) 
The integral form is: 
n 
on = | Pm (Pax) de (6.127) 
a 


where {¢,(x)} is a system of functions orthonormal in [a, 5]. 
For instance, 


6m = =All cos mx cos mx dx. (6.128) 


: : : n : 
3°, The binomial coefficients or Cyt, where n is any real 
m 


number and mm is a positive integer, are defined by 


o) = n(n—1)...(n—m+1) 


a = (6.129) 


When n is a positive integer: 


n n! 


The beta function is a generalization of the binomial coefficient 
(see § 4, sec. 5, 2°). 
Some relationships between binomial coefficients (nm, m integers): 


G) =0 for n>0, m>n. (6.131) 


m 
n n 
& = aa (6.132) 
n n n+1 
Gye Gaat)= a) (9-192) 
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n n+l n+k n+1+k 
(c)+( J++ 2 )=( : ). (6.134) 
- aera 09 tS m("Z'): (6.135) 


Qn+1\ /2n41 on+i : 
( )+( ; Jeter) = (6.136) 


n n n n= 
(o)+(a)+(4)+ =? 1, (6.137) 

n n n n— 
(+3)? i (6.138) 
(0 }+ )+ ede +(,-1) = 227-2 (nis odd). (6.139) 


an 
0 }t\2 
an\  /2. 

£ = 220-2 (pj 
(1)+(G) +404) 22-2 (n is even). (6.140) 


= 3—1M 5 cs =. (6.141) 
(o)+(3)+(S)+--= 3 (24200). (6.142) 
(HG) Hone) 
(}e(2p(iJenFeere te) ene 
(}:)(aeoeHloreten). 
OO a lar? cies 
(2)+(2)+(a)+---a(22-F ea). Go 
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(n)+(4)+(4 e.g (a2? sin) (6.148) 
(7)-(3)+(4)-(4) + --- = 2 cos (6.149) 
Oe) GG rae 

(n)+2(7)+3(5)+-- to40(" )=esaee (6.151) 
(7)-2 (3): (3)- - +(-1em(*) =0(n#1). (6.152) 
s(i}-3(3 + ATE (= ap: (6.153) 
(s)o4( Jods) eatn (2) 2a aes 
a(a)+E()+ F(a)+ ar (2) are 59 
(1)-2(2)+3(3)- = (7) 
= 1tyt ecto. (6.156) 
Cr AG) hea) 
= 2424... 42%. (6.157) 
(a)(t)*(1)(eer) Ca) ) ("9 
(o)(e)*(i) (ati + +(e) (a) > 
=( .-%) > Gar (6.159) 
BIGGER em 
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(3)-(rYe(B) em) 
(6.161) 


Qn+1\2 /2n+1\2 2n+1 
( 0 it , yr ste =0. (6.162) 
2 


= Qn-1) ee We sie (6.163) 


Binomial and polynomial formulae: 


(a, +42)" = ayias.. (6.164) 


Vy +¥gen AM, ! 
(Qq\+a,= ...+4,)" = 
! 
= aes ayiayz ...anr. (6.165) 


Vi +Pet+.. tYpen 9 !r,! eae Vp! 


Some identities in connection with binomial coefficients: 


Bay) x*(1 —x)n-k = x. (6.166) 
E()acra(etjede am 
2 (F-))(f)a-as = e. (6.168) 


k=O 


The Bernshtein polynomials B,(f) of a function f(x) are defined by 
the relationship 


B= EE) MIG) 6.168) 


If f(x) is continuous in the interval 0 = x < 1, the sequence{B,(f)} 
is uniformly convergent to f(x) in this interval: 


lim B,(f) = fix). (6.170) 
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Asymptotic formulae. 
2n aan On 
(4) ~ wae |0,| <1. (6.171) 
i te 
(=) = or = as mee, (6.17) 
m"*2(n _ m) t+? 
met 

nfn\k 2kn/f2\ 2 
—) . —=[{— : 6.173 
2G)“ gle) oe 

nk+l+b 





nk +1 (kK-1)"(_k _ 
( : e Pint F) (6.174) 


Fibonacci numbers and the golden section. The sums 


Pod (n-aeen 
m= ( A ) (6.176) 


are connected by the relationships 
Un = Unitin» 2>2, 4 = m= 1, (6.177) 


The numbers u, are called Fibonacci numbers. Binet’s formula holds: 


(4y-(54) (6.178) 


JS 


The following are consecutive values of the Fibonacci numbers: 


un, = 


Uy, Ug, Ugy.0 
1, 1, 2, 3, 5, 8, 13, 21,... 


The Fibonacci numbers appear in the expansion as a continued 
1 1 

~ T+1+.. 

have the form u,/u,,,(m = 1, 2,...). 


fraction of the number + (J 5 -1) . The convergents 
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1 
The number e = 7 (V5 ~1) is occasionally called the number of 


the golden section. It is defined as the mean proportional between 
1 and its complement to 1: 


a? = 1(1—2). 


It was supposed in classical aesthetics that, for instance, the rectang- 
le with ratio of sides «, or the ellipse with ratio of axes a, were partic- 
ularly pleasing to the eye. Hence the name golden section. 


§ 2. Bernoulli and Euler numbers and polynomials 


1, Bernoulli numbers and polynomials 


Special number sequences, e.g. Bernoulli and Euler numbers, prove 
useful for obtaining power expansions of numerous functions. 

1°. The Bernoulli numbers B,,(n = 0, 1, 2, ...) are defined as the 
coefficients of the expansion as a power series of the function r(e'—1)71 
for |t| < 22: 

Sgt = », B, aa . (6.179) 

These numbers were first mentioned by Johann Bernoulli (Ars 
Conjectandi, 1713), inconnection with the problem of summing powers 
of the natural numbers. The numbers B figure in the power expansions 
of the functions tan ¢, tanh ¢, t cot t, t cotanh f, etc., in the Euler— 
Maclaurin summation formula, in the asymptotic form of Euler’s 
gamma function. 

There is no one accepted notation for the Bernoulli numbers, In 
certain works, B, is used to denote what we denote in the present sec- 
tion by | B,|, or Bay, oF | Ben |. 

Recurrence relations. Using (6.179), rewritten in the form 


PENT Re 
gee ee” 


cross-multiplying the series on the right-hand side and comparing 
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coefficients of powers of t, we find that 


Chi Bat CR Bait o0- + Cha Bnansit «>> 
eee + Chi Bit By = 0 (6.180) 


or, in symbolic form: 
(1+ B)?+i— Br+1=0, (6.181) 


where, after raising to a power in accordance with the binomial for- 

mula, all the exponents of the powers are replaced by subscripts. 
Since 

t(et— 1)-2—(— n(e“*—-1)-1 = -t = 


25 B ee (e483 
= RY ak+1 DT It (6.182) 


all the Bernoulli numbers with odd subscripts, = 3, are zero. All 
the Bernoulli numbers with even subscripts are non-zero, B,,, being 
positive for n odd and negative for n even (see (6.194)). 

Laplace’s formula 


1 
3T 1 0 0 
1 1 
3 oT 1 0 
B, = (—1)"! 4 1 1 (6.183) 
ss a 3ST or eee 0 
Hi ail ad 


(+l! nt @—D! °°* 2! 


gives an explicit expression for the value of a Bernoulli number in 
terms of its subscript. 

The Bernoulli numbers are rational. This follows, for instance, 
from the previous formula. 

STAUDT’S THEOREM. Every Bernoulli number B,, can be written in the 
form 


1 
Bn = Ca~ DET? (6.184) 
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where C,, is an integer, and the summation is over all k > 0 such that 
k+1 is prime, k being a factor of n. 

For example, when 1 = 6, the factors of n are k = 1, 2, 3, 6. On 
adding unity to each of these, we get the numbers 2, 3, 4, 7, of which 
the primes are 2, 3, 7. Consequently, B,= 1—(1/2)—(1/3)—{1/7) = 
= 1/42. 

Some Bernoulli numbers: 


7 
Bu= > Be= ——sig > Bis = “agg 
B — — 274611 _ 854513 
calle 330° 3” 


236364091 8553103 
Bu = 37399 + Bu = 


23749461029 _ 8615841276005 


a 870 > Bao = 14322...” 
7709321041217 2577687858367 


a eT Sa 


26315271553053477373 


i 1919190 ; 


29299939 13841559 
Bsg = tig 8 By = 


__ 261082718196449122051 
13530 


Some power expansions with coefficients expressible in terms of 


Bernoulli numbers. Since s coth $ t = {t/(e"—1)} +5 it follows 


from (6.179), after replacing ¢ by 2¢, that 


eo 22nB, fam 
t cotanhr = 1+ ) an 


noi any!” |t]}<2. = (6.185) 
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it cotanh it = tcott, tant = cot t—2cot 2zt, 


t 
tcosect = tcott+ftan—, 


tanh ¢t =2 cotanh 2¢—cotanh f¢, 


cosecht = — cotanht — cotanh =, 
we get 
(= 1)"27"B,, 
tcott = 1 —————— 1a, | t 7. 6.186 
+ |th<m. (6.186) 
eo (22m — 1)22%( — 1)n-1 _ od 

tant se? crea) ace Bont?” 1, |t] < 7 (6.187) 

2 (2 — 22"\(— 1)" 
tcosect = one Boyt, |t| <7. (6.188) 

= 5 22-1) pp pant = 

tanh t =2 Gnyl Bo, t-1, | t| < > (6.189) 


tcosech t = 1+ p> ar Bapt?®-1, |t| <2. (6.190) 


( =, yr22n Bon 





in = be Lala mn itlen, (6.191) 
n= . 
_ & (= 1)7224(22"- 1) Ban an x 
eo = aba er, [t|< 7? (6.192) 
tant (—1)P#1292-1_)B,, nm 
n= any mm, |t]< >. (6.193) 


Expressions for the sums of some numerical series in terms of 
Bernoulli numbers. If we compare expansion (6.186) with 


1 


teot= 1425) oy Cy =i 25) oe ey mer 





it follows that 
(—1)"-12(2n)! = 1 


Bon = (27)2" wa, mn . 





(6.194) 
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The equations follow from (6.194): 
Sot (-1)"1Qn)™ 
y = 








wey mim (Int Bar: (6.195) 
EG ot = 6196) 
a oF = ee Bon: (6.197) 
In particular, 
= aa oa =. (6.198) 
2G pie = ae = =. (6.199) 
> one I~ — 7 = (6.200) 
ia = ue (6.201) 
Dame 7 aS" (6.202) 
ig = = (6.203) 


Some integrals expressible in terms of Bernoulli numbers. Integral 
forms of Bernoulli numbers. The relationship 


1 =_ 1 ie —mts2n—1, 
mi ~ Gn! ve oe 
leads in conjunction with (6.194) to the following relationships: 
oo ¢2n—-1 
Bon = (—1)®-14n ; ory 4 (6.204) 
co fendt 
Boy = (— era | (ete (6.205) 
2n(2n ~ 


Bon = (—1)"-1 


1) [rere ee ae (6.206) 
oe 0 
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= = D an 4n bad pan—-1 
an = (1 () WT | » siohpt CAD 
n x)2"-1 
= (1 sceae ae (6.208) 


oo 2n—1 
2n (ia tj-1 








Bn = ("ana | a 
Bie Hee ass I. oot. (6.210) 
= = |e ps t & (6.211) 
1+2? 
Boy = (= ee fon Qaim dts = (6212) 
Bay = (-P amma | (ntan set >. (6.213) 
0 


Bonae = (- 1)rti sites) I. (In t)2n In a — ye. (6.214) 


2°. The Bernoulli polynomials are given by the formula 
n 
B,(x) = («+BY = ¥ (z) Bpxt-k, (6.215) 
R=0 


A number of authors consider, in addition to the polynomials B,(x), 
the polynomials 


Pn(x) = B(x) — By. (6.216) 
It follows from (6.215) that 
B,(0) = By, n(0) = 0. (6.217) 


The generating function for the Bernoulli polynomials is te*(e' ~ 
—1)~1. Its expansion as a power series, convergent for |¢| < 27, 
has the form 


eo nr 
reM(et—1)-1 = ¥ B(x) —. (6.218) 
n= n!} 
The difference equation 


Sf(x+1I)—f(x) = nxt (6.219) 
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is satisfied by the Bernoulli polynomial. This follows from (6.218) 


and the relationship 


tele+Dt(et — 1)-1 — text(ef—1)-1 = te™, 


Recurrence formulae. Differentiation of (6.215) gives 


B,{x) = nBy_x(x) 
from which it follows that 
x 
B,(x) = B,(0)+n i} By—1(x) dx. 
(1) 
Some Bernoulli polynomials: 
B(x) => 1. 


1 
Bx) = x- >. 


B(x) = 2—x+ -. 
B,(x) = Bo SB4 x. 

B(x) = MW toz, 

B(x) = BS xtg Seis x. 
B,(x) = aps xt Stes, 
B(x) = x7- ee ee 


B(x) = xP ~ 4x? + x8 — xh = 


14 7 2 1 
3 3 30 

9 21 3 

ee eed cer Ses 
B,(x) = x' 5 x®+ 6x % xP+2x3 0 * 


By (x) = x0 5x04 2 x8 — 7x84 st 3 ty 5 


66° 


(6.220) 


(6.221) 


(6.222) 
(6.223) 


(6.224) 
(6.225) 
(6.226) 
(6.227) 
(6.228) 
(6.229) 
(6.230) 
(6.231) 


(6.232) 
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Zeros of Bernoulli polynomials. The following formula holds: 
B,(1—x) = (— 1)"B, (x), (6.233) 

from which, letting x = 0, we get 
B,(1) = (—1)"B, (6.234) 


and, since B,,,, = 0, we have 


B,0)— 8B, = -B,(1)— B,(0) = 0 (6.235) 
for all 7. 
It follows from (6.216) and (6.235) that 
Pn(0) = Pall) = 0. (6.236) 


It follows from (6.233) with n=2k+1 and x = ; that 


1 1 
Bop+1 (z) = — Bopsi (3) (6.237) 


or 


1 
Pok+1 (3) = 0. (6.238) 


The polynomials ¢,(x) with even subscripts vanish on the segment 
{0, 1] if and only if x= 0 or x = 1; the »,(x) with odd subscripts 
vanish if and only if x = 0, x = > orx=1. 

The polynomials ¢,,(x) with even subscripts are of constant sign, 
the same as that of (—1)*, on the interval (0, 1); the polynomial 


Por+1(X) has the sign of (— 1)*~ on the interval (0 3) and the 
sign of (—1)* on the interval (> 1). 
A multiplication theorem for Bernoulli polynomials: 


—1 
B, (mx) = m"-1"> Bn (= + =) : 


s=0 
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This relationship follows from the fact that 


& B,(mx)t™ emit 1 emetmi(itet+ ... felm-D) 


nant! e—] m | 
Pasta pn 
jo miee Atm) ie ] m=1 = »(#+ )n : ore 
i es eu] ~ mM 6% n=0 n! a 


Trigonometric expansions of Bernoulli polynomials in the interval 


(0, 1): 





B(x) = x— ~j=- bya slat (6.241) 
BO)= = oe (6.242) 

aT ae Bu) = sm tS. (6.243) 
Grp Fen@) = game S, Ge 2M) 


Integral forms of the Bernoulli polynomials in the interval (0, 1): 


= cos 2nx— e~ 3! 
aa ronan | gosh 2at— eos inx (6.245) 
0 
(n= 1, 2,...). 
“ sin 27x 
= (—])"+1 ee eg 
Banas) = (—DQ2n+1) | ” aE Ht 6246) 


(n = 0, 1, 2, ...). 


Application to the summation of powers of the natural numbers. On 
assigning to x in (6.219) the values 0, 1, 2,..., p and summing, we get 


$ nna = PP+ Y= Br 


sal n 
or, on replacing n—1 by 7, 


. so = Fri P eho aut . (6.247) 
s= 
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For example, 
B3(p+1)—B. 1 3 Pp 
2 3 3 es ae in 
3 Se alta? FS 


_ P(p+ nep+ 1) 6.248) 


_ Blet+i-B 
oat 4 


2 B(pt+l)—B, _ 1 ey 
4 SST Ts ~ | pS opti pf) 
1 
= 39 P(e + Dp + NGp?+3p+1). (6.250) 


ee 3("- 542 7) 


= 5 (pt 2p +p) =Fe+ (6.249) 


= 3 +— 4 
ea 6 Lae 


P+ DAOpt+ 2741). (6.251) 


The Euler—Maclaurin formula establishes the connection between 
the integrals and the sums: 


| ” in) des |e : f0)]- 
0 


-§ on [f@r-)(m)— — foar-1(0)] — ae (6.252) 





If f(x) and all its derivatives encountered in (6.252) tend to zero, 
while the derivatives of even order differ from zero and all have the 
same sign, the summation formula holds for m = o, if the sum and 
integral appearing in it are convergent. 

Stirling’s formula is obtained from the Euler—Maclaurin formula 
if we put f(x) = In x in the latter and make the lower limit of integra- 
tion equal to unity: 


oy Ink = mlnm— m——In(m+1)+ 
=1 
n=1 By (m-3+1— 1) 


- py ~~ r(2r—1) —Rp-1. (6.253) 
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When n = 2, it follows from (6.253) that the asymptotic Stirling for- 
mula for the factorial] (see (6.121)) is 


1 
m! = /2am™ * ®e-m, (6.254) 


2. Euler numbers and polynomials 


1°. The Eyler numbers E, (k= 0, 1, 2, ...) are defined as the coeffi- 
cients in the expansion as a power series of the function 


hee eee. Wee (6.255) 
ge hKY? 2° . 


Since the function sech ¢ = 2/(e'+e7‘) is even, it follows from 
this that the Euler numbers with odd subscripts are zero: 


eym41 = 0 (m= 1, 2,...). (6.256) 
Recurrence relations. It follows from (6.255) that 
co {2n eo yk 
= 2 ml yD? (6.257) 


n=0 
whence E, = 1 and 
Eq + CinEa + CinEyt «++ + Cin Eon + Fan = 0. (6.258) 
In symbolic form: 


(E+1)"+(6-1)" =0, Ey = 1. (6.259) 
Some Euler numbers: 
£E=1, R= -l, &=5, B= 61, EF, = 1385, 


Ey) = —50251, Ey, = 2702765 
Ey = —199360981, Ey, = 19391512145, 
Eyg = —2404879675441, Ey = 370371188237525. 


All the Euler numbers are integers. This follows from the recurrence 
formulae for the £,. Two adjacent numbers with even subscripts 
have opposite signs. 

SYLVESTER’S THEOREM. If a, B, y,... are factors of the number 
n—m, the difference E,,—Eym, is divisible by those of the numbers 
2a+1,2B+1, 2y+1, ... that are prime. 
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The connection with Bernoulli numbers. Starting from the identity 








4x = 2x 2xe-* 
ex—] ee] ep e-*’ 
we obtain: 
Ber Y= - Fa - & ment See 
n=0 as 1! 
from which it follows that 
n(E— 1)"-1 
By = ne (6.260) 
Starting from the identity 
4x e 4x 
ef — ] tr eee e+e7*’ 
we get 
28 m aie a | a el Dine ax 2 En kr 
which gives 
kh k 
Eni = GB+3"—-G4B+ I" | (6.261) 


2k 


It follows from the last relationship that 


k+1 3\2h+1 ] \2k+1 
acct 2a =(2+z) -(3+3) » (6.262) 


which gives, on taking (6.215) and (6.233) into account, 


2k+1 l 
24k +2 Ea, re 2Bors1 (z) . (6.263) 


The sign of the Euler numbers. As follows from the discussion on 
page 329, B,,,,(x) has the sign of (— 1)*~ in the interval (0, 1/2), 
so that E,, has the sign of (—1)*. 

Some power expansions with coefficients expressible in terms of 
Euler numbers. Observing that sec t = sech it, we get 


en we pee: (6.264) 


sect = ." — 1)? 
PA ) 2 
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On integrating the last series, we - 


tan (Zt 3)|> 5 1k ae Gk I11<<. (6.265) 


Integration of series (6.255) gives 


In 








2 h+1 
arctan ef = = 4 = : : 


a+ 2,2 7* GDI 
The expressions for the sums of certain numerical series in terms of 
Euler numbers. On putting x = 1/4 in (6.244) and taking (6.263) 
into account, we get 
1 1 1 (— 1RE,,22h+1 


1—onna t+ penta ~ Gees t+ = Feri (6.267) 


(6.266) 


For ‘example, 
Dy ey wit 2 ep” Gms = 32" 
Integral forms of Euler numbers. It follows from (6.246) and (6.263) 
that 


Eon = (— 1)"224+1 | “18 sech (xt)dt (n= 0,1, 2,...). (6.269) 
0 


(6.268) 


2°. The Euler polynomials are given by 


hij = & -3+3) = > ( : ) 2-*E, (= z a) , (6.270) 


where £, are Euler numbers. 
The generating function for the Euler polynomials is 2e*(e'+1)-}. 
Its expansion as a power series, convergent for | t| < 2, is 


th 
2et(et + 1)7} = DFG) ae (6.271) 
The difference equation 


S(e+1) +f) = 2x" (6.272) 


is satisfied by the Euler polynomial E,(x). This follows from the 


relationship 
Zele+Diet 4 1)-2 4. Zewt(et + 1)-1 = 2e*, 
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Recurrence formulae. On differentiating (6.270), we get 


E,(x) = nE,~,(*) 
from which it follows that 
] x 
en(x) = Ey (3) +n | Eq_(x) dx. 
1/2 
Since E,,(1/2) = 2~"E,, (see (6.270)), we have 
E,(x) = nen" E,-1(x) dx. 
1/2 
In view of the relationship 
eo Pr 00 mm. eo 
deere 1-2 = SE) YS = ¥ eet) 
Tr=0Q Fi m=0 m n=0 
we have the recurrence formula 
= n 
Bett) = 3 (F)E 
r=0 
or, on taking (6.272) into account, 
an 
- E,(x) = 2x*- > G ) Bt. 
r=0 
Some Euler polynomials: 
E,(x) = 1. 
1 
E(x) = x- 5. 
E(x) = =x. 
2 cg ah 
E,(x) = Wma Kx +7: 
E,(x) = x4-—2x3 +x. 
ee ae ee ee. 
E(x) = x5 5 xh+5x >: 
E,(x) = x8 — 3x5 + 5x3 — 3x. 
7 35 21 17 
see ce Oh pause 
E(x) =x Zetex a +. 
E,(x) = x8 — 4x7 + 14x5 — 28x3 — 17x. 


t® 
ri 
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(6.273) 


(6.274) 


(6.275) 


(6.276) 


(6.277) 


(6.278) 
(6.279) 
(6.280) 
(6.281) 
(6.282) 
(6.283) 
(6.284) 
(6.285) 


(6.286) 
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The connection between Euler and Bernoulli polynomials, Starting 
from the relationship 


xt [ t -1 t xt 
=—{ = (x41) = — 
te? (4 si) = fe 2 (et 1)-1— te 2 (et—1)-}, 


we get 


Eqa(2) = 1-224 {P( xi )-2, (=)} = 


= n-12 {Be 2"B, ()} . (6.287) 





Trigonometric expansions of Euler polynomials. On using the 
trigonometric expansions of Bernoulli polynomials in the interval 
0< x <1, we get 


Enx(x) = (—D* 4(2)! 3 [(2m-+ 1a]-242 sin (2n + Ix 
ned 
(n = 1, 2, 3,...). (6.288) 


Eopas(®) =(— DF 40k +1! Ylen + 1)n]-28-2 cos (2n + Ix 


(n = 0, 1, 2, 3,...). (6.289) 
A multiplication theorem: 


m1 
E, (mx) = m" ¥° (-1E, (= +z), m=2k+1. (6.290) 
r=o0 


m=-1 
E,(mx) = —2m(n+1)72 ¥ (- WBan(x+ 7)» m= 2k. (6.291) 
r=0 


Integral forms of Euler polynomials may be obtained in the same 
way as those of Bernoulli polynomials: 


12" sin zx cosh xt 


Ex,Ax) =(—-1)"4 Ve ee (6.292) 
0 


cosh 27t — cos 27x 
O<x<1; n=0, 1, 2,...), 


eo ¢2n+1 cosxx sinh zt 
= (~])nt1 ft Gee eee» 
Fang i(x) = (— 1414 I. S Sah DARE Dou ons dt (6.293) 


O<x<1; n=0,1,2,...). 
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§ 3. Elementary piecewise linear functions and delta-shaped 
functions 


1. Piecewise linear functions 


1°. The absolute value of x (written as |x) is: 


| x <0, 

|x] = 0, x = 0, (6.294) 
| x, x > 0. 

Jxt+y| S |xl+lyl, |x-yl = Ilxl—-IyIll. (6.295) 


The binomial expansion of |x| = Pe 1—(1 — x), for |x] < 1, is 
l=7 > (2k — 3)!! 
2 nee (2k)! 


The approximation, for |x| = 1, by Bernshtein polynomials (see 
§ 1, sec. 2) of even degree is 


Tt. . 1-x?7\" 2 2n 1+x\? /1-x\* 
isl = etn ("YE *(aee)[ (es) #(735) | 


(6.297) 





|x| =1— (1 — x”), (6.296) 





The approximation by Fejer polynomials, for |x| s 2, is 
E 8 "1 n—k cos (2k- | 


2%, 2n-1) K-17 
(6.298) 
The expansion in Legendre polynomials P,(x) (see Chapter IV, 
§4, sec. 5), for |x| < 1, is 


\x] = lim Oon1 = lim 
R—> 1 


Ixl = ¥ anPa(2, 
n=0 


1 5 2k — 3)!! 
Mr4+1 = 0, = 7,2 = Bs a= (— DM (Ae + DE 
(6.299) 
Fourier’s expansion, for |x| < 2, is 
_ % 4 & cos(2k+1)x 
a aa ae 2 Qk+1? ° (200) 
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The integral form is 
ise 7 ee as JOOS H rf. (6.301) 


Polygonal functions; the approximation of continuous functions by 
polygonal functions. Let A(x, y) (i= 9, 1, 2, ..., 7, ...) be given 
points. The function 


k 
SAX) = Yotz [x— Xo +|x—XolJ+ 


+5 = (kigr—k)x—x)+]x—x 1], (6.302) 


where k; = (i41—-Yp/(%i41—%), 18 described as polygonal; its 
graph is the polygon 44,4, ... A,. It must be borne in mind that 

qir-etlnall =] for x sa, 

x-a for x>a, 


If f(x) is a continuous function in [a,b] , there corresponds to 
the subdivision @ = %»< x,<%,<...<%x, = 5 a polygona 
function whose graph is a polygon inscribed in the graph of f(x), 
with vertices at the points (x,, y,), ¥; = /(x;) ( = 0, 1, 2, ..., m). 

Every continuous function is the uniform limit of polygonal 
functions. 

On taking expansions (6.296)—(6.301) into account, we find that 
any polygonal function, defined in an arbitrary segment [a, 5], is 
the limit of a polynomial sequence, uniformly convergent in [a, ] 
(Weierstrass’s theorem). 

Schauder’s basis. The polygonal function 


Fog(t) = Gaz (lea [2x—a—Bl+12—B I), @ < B, (6.303) 





is equal to zero outside the interval («, 8); in («, B) its graph is an 
isosceles triangle of height 1: 
Fuap(x) = 0, x < a, x > B; 
at+p 
7? 


a+p 
ane 





F. p(x) = 2x—2a, x < (6.304) 





Fap(x) = —2x+28, x > 
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Let y = f(x) be a continuous function in (a, 8). We introduce the 
numbers 





ad =S(25*)-ZU@+ABL 6308) 


Schauder’s basis is defined as the sequence of functions in [0, 1]: 
1, x, F oi(x), F 1@), F +, Oo F 10), 


P x) ...,F X) pence 
4 ; ® rg 6306) 


(i= 0,1,..., 2-1; k=0, 1, 2,.... 


Any function f(x), continuous in the interval [0, 1], can be expanded 
(uniquely) as the series 


S@) = (0) +0) ee + 
+ 23% di ing Fa ia (2). (6.307) 


¥ 2 iso Qe oF my 
The partial sum of the last series 
Sa(x) = (0) +0) a x+ 
+¥ S. di ta) Fi ie (x) (6.308) 


k=O i=0 oF oF 
has a graph consisting of a step-function, inscribed in the curve 
y = f(x), with vertices at the points (i/2", f(i/2")) (i = 0, 1, ..., 2"). 
The derivatives of the functions of Schauder’s basis form a system of 
Haar functions (see (4.24) and (4.25)). 
2°. Sign x (signature x) is 
-—1 for x <0, 


sign x = 0 for x = 0, (6.309) 
1 for x>0 


or 


for x #0, 


{ x 
sign x =? |x| (6.310) 


0 for x=0 
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or 
sign x = lim = re tan (6.311) 
n—> co % 


Fourier’s expansion is 


4 = sin (2k+1)x 
sign x = — ya. Ix}<2. (6.312) 


TR 


The expansion in Hermitian polynomials (see Chapter IV, § 4, 
sec. 10) is 


2n—2)! 2n 
sine = F(T Hanes). 6313) 
The integral form is 
2 (=T sin t 


dt. (6.314) 





signx = lim — 


To % Jy 
The sequence of signs of sine (Rademacher functions) is 
p,(t) = sign (sin 2kzt), (6.315) 
7,(t) = sign (sin 2kzt). (6.316) 


3°, The integral part x (written as [x], entiére x, E(x)).Ifx = n+r, 
n is an integer, O=r-< 1, then [x] =n. 
The following relationships hold: 


[x+y] = [xX]+D); (6.317) 
| = [>| , Wis an integer; (6.318) 


p+ [x47] cot[et >| = [nx]. (6.319) 


If p and g are mutually prime integers, we have 


elle ete |e 
[tS ]+---+[z}+--+[4]- 


= S+5pt+ ... +Sp+ ... +5,, (6.321) 


where s, is the number of factors of k. 
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Fourier’s expansion is 


1 & sin 22nx 
x—[x] = eT 


i (x #0, +1, +2, +3, ...). (6.322) 


JX 


The function {x} = x— [x] is called the fractional part of x. It is a 
periodic function with period equal to unity. 
4°. The distance to the nearest integer [denoted by (x)] is 


(x) = min {x— [x], 1+[x]—x}. (6.323) 


The function (x) is periodic with period equal to unity. 
The Fourier expansion is 


& cos 2x(n+1)x 
ps 


La (6.324) 


1 2 
= 4a 


5°. The jump function 1(x) (Heaviside’s unit function) is 


is | ON SGE: aes) (6.325) 


The rectangular pulse is 


0 for x<a, x > 8, 


. (6.326 
1 for esx sf, pe ) 


1e—f)= (ea) = | 
If f(x) is a continuous function in [a, 5], the sequence of functions 


fis) = SACU 2 1G—m) 6.327) 


tends uniformly to f(x) on indefinite subdivision of [a, b] by the 
points x,: 
A=X%< %<X%y< 1... < X= dD. 


6°. The representation of certain piecewise linear functions with 
the aid of integrals and series: 


2 (“sin éa 1 for O< x <a, 6.328 
Ei, é cos bx d= | 4 for x 2 a. nee 


I. aJ, (ab) Jo(Ex)d& = | 1 for 0<x<a, 


0 for x >a. 





(6.329) 
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+1 = for pee 











2 2 2a nt nx 2 
— ¥ — sin cos — = 
a 2,70 2 a 1 
—1 for zasx<a. 
2 : 
— ¥ (-1)"1— sin — = x, O58 x54. 
a nei 
25 ee sae Osxsa. 
a 70M a a 
x for Oat ty 
pees 2a" in em gin | canny Si 
sa a —_— 
@ rey nt . - |e-s for jasxsa. 
cos re uw — cos 
cd 6 6 ut 
2 | A eos 5 = 
1 for |t| s 1-6, 
ie Fit) for 1-6 s/t) = 1. 
0 for |t| 21. 
sin? = 
2 en 2 ces. 1-|t| for |t| =1, 
woo 7X" 0 for |t| =1. 
1 for Os x <a, 
a | cosexee = Z for x =a, 
a), 2Z 2 
0 for x>a 
2 pesinar, [72 Br a= 
| a. 0 for «= 0Q, 
0 * for «> 0 


(6.330) 


(6.331) 


(6.332) 


(6.333) 


(6.334) 


(6.335) 


(6.336) 


(6.337) 
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0 for x < a—A, 


= for x = a—h, 





. 2 (7 sinht 5 
— z| = 008 (x—a)tdt=< 1 for a—h<x <a+h, 
moo 0 
5 for x = a+h, 
0 for x > ath. 


(6.338) 
2. The 6 (delta)-function 


A sequence of functions {u,(x)} is said to be weakly convergent 
in the interval (a, b) if, given any continuous function f(x), the fol- 
lowing limit exists: 


lim (y I (x)u,(x)dx. (6.339) 


If the sequence {u, (x)} satisfies the conditions: 
I. For any M > 0, we have for |a] = M, |b| = M: 


7) 
| u,(x) dx 


a 


< K(M); (6.340) 








II. Given fixed a and 4, |a| > 0, |b| > 0, 


lim aes 0 for a<b<0 or O<a<b, (6.341) 
pare} a 1 for a<0<b, 


then the limit (6.339) exists, does not depend on the choice of sequence 
{u,(x)} and is equal to f(0). The limiting element of the (weakly) 
convergent sequence {u,(x)} is referred to here as a delta function: 
6(x). Thus 


ii S(x)6(x) dx = f(0). (6.342) 


Sequences satisfying conditions I and II are described as delta- 
shaped. 
Examples of delta-shaped sequences are: 


e> 0, u,(x) — d(x); (6.343) 


1 € 
WO) = Re? 
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x2 





1 et 
u(x) = Bae e#, t>0, u(x) + d(x); (6.344) 
Hee - O<v<, u(x) +d(x). (6.345) 


The elementary properties of the delta function are: 


6(—x) = 6(x); (6.346) 
I(x) 6x! — x) = A(x)O(x’— x); (6.347) 
x(x) = 0; (6.348) 


da—x) _  b—x) 
WO= 2 eel “Liga? 634) 





where x, are the simple roots of the equation p(x) = 0; 


8(x) 


(ax) = Ts (6.350) 

_ &x—a) + d(x4+a), 
(x2 — a2) = ero (6.351) 
|x]6(x2) = 6(x). (6.352) 


The convergence of the series expansions and the integrals quoted 
below is understood as weak convergence. 
The Fourier expansion, |x| = ], is: 


(x—x') = atys Dy cos a (6.353) 


The expansion in Bessel functions (see § 4, sec. 6), OS rs R, is: 


AG x) (: z) 
le A OR 


The expansion in Legendre polynomials, |x| = 1, is: 


A(x’ —x) = ya a(x')Pa(X). (6.355) 


& 
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The expansion in Hermite polynomials is: 


= ate! 
ie’— 2) Y ae 2 H,(x')H,(x). (6.356) 





Integral forms. Fourier’s integral is: 
&(x'~x) = = | * cos k(x’ — x) dk, (6.357) 
The Fourier—Bessel integral is: 


irr) = JF | ” Ig(kt Jnl’) dk 


= (6.358) 
Or’) = r’ | kJy(kr’) dk. 
0 
The involution is: 
i. B(t— wy)8(t— sat = By — 1) (6.359) 
The derivatives of the delta function are given by: 
(x) = 1'(x); (6.360) 
a S(*)8(x—hA) dx = —-f'(h); (6.361) 
. ST (x)b(x — A)dx = (—1)F F(A). (6.362) 


Series of delta functions are: 


cos x+cos2x+...+cosmx+...= 
Bs -s+8 > &(x—2an); (6.363) 
sin x+2 sin 2x+ ...+nsinnx+...= 
= —n¥ 8(x—2an); (6.364) 
cos x +4cos2x+... +7 cosmx+...= 


= —2¥ d"(x—2nmn). (6.365) 
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§ 4. Elementary special functions 
1. Elliptic integrals 
DEFINITION. Any integral of the form 
= R(x) 
dx. 
0 VP)” 


where R (x) is a rational function of x, and P(x) is a polynomial of 

the third or fourth degree, can be transformed to a sum of integrals, 

reducible to elementary functions, and to integrals known as elliptic 

integrals in Legendre’s normal form. The latter include the following: 
the elliptic integral of the first kind, 





in? dx 
F(k, 9) = ——=————; 6.366 
(k, 9) i Saas (6.366) 
the elliptic integral of the second kind, 
sing /7_~p2,3 
E(k, 9) = | Miske dx; (6.367) 
0 V¥1—-x* 
the elliptic integral of the third kind, 
in p dx 
val k; 4, = Fl a —— 6.368 
¢ ”) ( (1 + Ax?),/( = x®)\(1 — k2x?) een 


The notations: F(y, k), E(p, k) and II(g, A, k) are sometimes 
employed. : 

The parameter k is called the modulus of the integral, and 4 the 
parameter of the integral of the third kind, k? < 1. 

The number k’ = /1—k? is called the complementary modulus. 

The quantity « is often employed, instead of k, where k = sin a. 

If we put x = sin y, the elliptic integrals reduce to the normal 
trigonometric form: 


? dy 9 dy 
Fk, = SS > 6.369 


0 
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? ? 
E(k, ) = (i J1—k? sin? yp dy = ii Ay dy, (6.370) 


Tk, a, 9) = ("___ ae = [" __* 
o (1+A sin? y) /1—k? sin? p o (i +Asin® p)Ap 
(6.371) 
where Ap = J1—k? sin? y. 


The following notation is used for a commonly encountered 
combination of these integrals: 


e = 
D(k, 9) = eT ae EE - f sin 


0 
in P x? dx 


. OST (6.372) 


Representations as series: 


Fk, @) = Lot 5 Fae xs 3 ak* + ar ae Agk® +o... (6.373) 
Ae-a)= y= Aik? Bice 8) ec caeyy Ae Wan 
34 346 
3335 Aqk®— 20.5 (6.374) 
where 
ie es | "sintnz de (2 =0,1,2,...). (6.375) 
; 


The coefficients A, can be evaluated successively in accordance 
with the formulae: 


Ay = 9, An = ae dant 5 cos 7 sin3"-1 gy, (6.376) 


If ¢ is close to 2/2, the following formulae are convenient: 


Fk, 9) = F(k 3)-F kk op. (6.377) 
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E(k, 9) = E(k, ) —E(k, 9;) + singsing,, (6.378) 


@, being given by the equation 
cos 


J1—F? sin? | 


If the upper limit of the integrals is equal to 2/2 (p = 2/2), the 
complete elliptic integrals are obtained. 
The complete elliptic integral of the first kind is 


sin 9, = (6.379) 


= 0/2 ap 
K= F(k 3) ie SS (6.380) 


The complete elliptic integral of the second kind is 


n/t 1 JT 
E= E(k, = Agdo = | ~———- x. 6.381 
(: 3)= i. oe i Jl-# 7 





Here, 
D=D (« 5) = ae (6.382) 
Representations as series and products: 
K=5 {! + > [Sar] aa (6.383) 
E= 5! +d (—1" cel ate (6.384) 
Dany [Ser Pes (6.385) 


nm 1—/1-K_, 
K = — Jy (1+k,); where k, pe hae a ky = k. 

2s i-Ji-B,° 
(6.386) 
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= 9Q°80°70°60° 

207 TTT Zito 

Se a AA 40° 

tit ft tt AA 30° 
Z 






Fic. §. Elliptic 
integral of the first 
kind Fk, 9)3 
k=sina=const. C0 





Fie. 6. Elliptic 
integral of the se- 
cond kind E(k, 9); 
k=sin « =const. 





095 10 20 30 40 30 60 70 8 90° 


—~ Y 
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ma 10 20 30 40 50 60 70 80 90° 


——t- (Y 


Fia. 7. Elliptic integral of the first kind F(k, 9); @ =const, k=sin a. 





a0 PPE Ce eer ett 
“0 10 20 30 40 50 60 70 80 90° 


———ia 


Fic. 8. Elliptic integral of the second kind E(k, y); gy =const., k=sin a. 
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The following formulae are employed when k is close to 1: 


K= m+(z) mes) (™- 1- =a) kit + 


1.3.5 \2 2 Na 








12,32,4 2 2 1 a 
+ 7242.6 ("aa -a9 ae k era (6.388) 
Here, m = In 4/k’. 
Some integrals are: 
Kdk 1 eD-K 
a= a ay a (6.389) 
Edk _k® K-2E. 
| 7: as nn (6.390) 
| Kk dk = E-k’K = P(K-D); (6.391) 
2 12 
{ Ek dk = LE n-ne. (6.392) 


Graphs of the elliptic integrals are shown in Fig. 5, 6, 7 and 8. 


2. Integral functions 


DEFINITION, The following definite integrals are known as integral 
functions: 
The integral exponential function 


x et 
Ei(x) = | ae dt (x <0). (6.393) 
The integral logarithm 
: * dt 
li(x) =} — (0 < x < 1). (6.394) 


> int 
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The integral sine 


si(x) = -[- SOE a (so = 5): (6.395) 


The integral cosine 
ci(x) = al. et at (x < 0). (6.396) 


In addition, the following notations are used: 
Si(x) = 5 +8i() = i: satay [si (0°) = 3] (6.397) 


Ci (x) = ci (x). (6.398) 


When x > 1, the function li(x) is defined as 


: i= dt il dt | 
lim t+ — |. 
eo] Jo Int pak Int 


When x > 0, the function Ei(x) takes complex values; the real 
part of Ei(x) is denoted by Ei(x). The bar above the Ei is occasionally 
omitted. 

Relationships between the integral functions are 


Ei(nx)=li@®) (x <2); (6.399) 
Ei(nx) =li(x) (x > 1); (6.400) 
life) =Ei(x) (x < 0); (6.401) 
Ei (ix) = ci (x) +isi (x); (6.402) 
Ei(x + i0) = Ei(x) F ai; (6.403) 
Si(—x) = —Si(x); (6.404) 
si(-—x)= —si(x) —2; (6.405) 

Ci(-)) =Ci() tm = (x> 0); (6.406) 





inz + 2 
Si(2x) = = + | (=) dt. (6.407) 
0 
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Representations as series are: 
Ei (x) = C +In(—x)+ Peo aan (x <0); (6.408) 


= xt 

Ei (x) = C+Inx+ = Sar (x > 0); (6.409) 

(In x)* 
kk! 


k 
in) (x > 1); (6.411) 





li(x) = C+In(—In +> (0 <x <1); (6.410) 
=] 





li (x) = C+Ininx+ 5 
kml 


xak-1 


: % = 
si(x) = a om (- 1! SE HGk oD? (6.412) 


ci (x) = C+in x43 (= (6.413) 
=1 


x2 
1 2k(2k)! ° 


Here, C = 0:57721 56649... is Euler’s constant (see p. 310). 
Approximate formulae (for small values of x) are: 





li) + — ~ ; 
In — (6.414) 
Si(x) = x; (6.415) 
si (x) ~ x- 53 (6.416) 
Ci(x) ~ Ei(x) = Ei(—x) = C4+Inx. (6.417) 


Asymptotic formulae (for large values of x) are: 


2h 3h 
! 
Goes mek 


I! 3! 5! 
Seas Caer daa Me ‘ Ree, 16419) 








x x x 
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i ! ! 
ci) = ( oon .)- 





xe x 
iG 3! 5! 





x 


Ei (x) = =; 


e7-= 





Ei(—x) 


Some numerical values are: 


Ei (—1) = —0-21938 3934... . 
Ei (1) = 1-89511 7816... . 


li (1-45136 92346...) = 0. 


Some limits are: 


lim si(x) = —z; 


x—> co 


lim ci (x) = + 2; 
x—> 


lim [x¢si(]=0 (@ <1); 
xX> + co 


lim [xci@])=0 (0 <1); 
X~—> + co 


lim e-* Ei(x) = 0; 
x—> +o 


lim xe™* Ei (x) = 1. 


xz +00 


Some integrals are: 





0 


0 





pay ‘ l1—e-™ 
[[B om at = x Bim) ae 


i: e-Pt Ci(gt) dt = -<hn (2 Ey 


(6.421) 


(6.422) 


(6.423) 
(6.424) 
(6.425) 


(6.426) 
(6.427) 
(6.428) 
(6.429) 


(6.430) 


(6.431) 


(6.432) 


(6.433) 
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Spar aunpee aac 7janceeeeeseeee 
Suanguns 





tt yA KH 
vo Ha 
y pA A+ 
Pee | 


1 Pr BERESeEee TT TTT TT 
-20 1B IRR 
——e X 
Fia. 9. Integral functions: the sine Si(x), cosine Ci(x), logarithm li (x) and expo- 
nential functions Ei(—x) and Ei(x). 
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Fic. 10. The integral exponential function Ei(x) and the integral logarithm li(x). 
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tens 2.0001 


4 (OLA 7: 
ll HOOQCA | || 


iin 
H anocoos HAH 
eeoneee N+ : 





SUSESuManSnane tes 
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ttt AL 
om 





Pe ee ee 
fe x 
Fic. 11. The integral exponential function —Ei(x). 
Seth es 1 Pp 
e~?t si (gt) dt = —— arctan=; (6.434) 
: q q 
(i cos t Ci(t) dt= if sintsi()dt=-7; (6.435) 
0 0 
” cit) dt = | s(t) dt = 2; (6.436) 
0 0 ‘ 2 
{ ” Ci@) si(t) dt = —In2; (6.437) 
0 
= Me m for « > B, 
f ci (at) ci (Bt) dt = { si (at) si (Bt) dt = (6.438) 
0 0 
5 3B for « < B. 


The graphs of the integral functions are shown in Fig. 9, 10 and 11. 
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3. The error function 


DEFINITION. The error function is defined as the function 
efee =f e-"dt — [erf(«) = 1] (6.439) 
ran 


It is often defined as 


P(x) = Z ae dt (6.440) 
% Jo 


or (by S.N. Bernshtein) as 


Oj a var J ox = + ect(). 6.441) 
Be Yaad o 2 aio 
The following notations are also encountered: 
2 i) 
erfox = l-erfx = —] e-" dt, (6.442) 
Zi 
L(x) = | e~® dt = es erfe x. (6.443) 
x 
Relationships between the functions erf x and (x) are: 
G(x) = ef { ~ ; (6.444 
wae(Z) au 
erf x = D(x ./2). (6.445) 
The derivatives of the error function are: 
d De i oy. 
Fe ert») = fe e-*; (6.446) 
d 0 
ZH PO) = [2 2, (6.447) 


The integral of the error function is: 


} eet eae = Soares +E e-*4.C, (6.448) 


% 
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Other integral forms are: 


x2 e-t 


erf x = zl, et (6.449) 
erf (xy) = —= ral e~ 242 dr; (6.450) 
erf (./qx) = is a vi dt. (6.451) 





x 
Fic. 12. The error function erf x = (2/./% ){ e~? dt, 
0 


The representation as a series is 


xek-1 2 oes oo DRy2k+1 
a he ORDER D! ee Ro Qk F DH 
(6.452) 
Asymptotic formulae are: 
r(k+4 
et (fz) = 1-te-s § 1p AR, 6.453) 
PANEER gp yee nt a , 


x 
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x= xelp and g?<2?; (6.454) 


1 ey 





ene l 1.3 1.3.5 
[! — art Ga ae tf (6.455) 


The graph of the function erf x is shown is Fig. 12, which also 
gives the graphs of tanh x and 1— e* for comparison. 


4. Fresnel integrals 


DEFINITION. The following functions are called Fresnel integrals: 
the Fresnel sine integral, 


S(x) = Jz. sin 1? dt [s+ = 5] (6.456) 


the Fresnel cosine integral, 


C(x) = ‘i cos t? dt cx +o) = Z| . (6.457) 


The following definitions of the Fresnel integrals are also 
occasionally encountered: 


x 
Stix) =| sntea=s( /2~), (6.458) 
a] 5} 


C*(x) = if cos = dt = c( fF *), (6.459) 
‘ 2 


Other integral forms are: 


(6.460) 





7 dt (6.461) 
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S(xy) = * sin (t?) dt; (6.462) 


mal 
C(xy) = man cos (y*1?) dt. (6.463) 
V2x Jo 
The representations as series are: 


xeh+3 
so) = [2 5 aera ree yi (646A) 


C(x) = [23° 1}* ——_ ey (6.465) 


The asymptotic formulae are: 








S@) = z = cos x?+O (+) (x +0); (6.466) 
C(x) = atts sin x?+0O (+) (x +00). (6.467) 


The connections between the Fresnel integrals, Bessel functions 
and the error function are: 


11 
S(x) = = ap I= Wat; (6.468) 


C(x) = z] 73 z (t) dt; (6.469) 


C(z) + iS(z) = [Ee (7 =) f2 i: edt; (6.470) 


C(z)—iS(z) = ae erf (z./i) = Ji. e-ittg,, (6.471) 
0 


Vu 
Some limits are: 
lim S(x)= lim C(x) = > (6.472) 
x—> + co x—> + 00 


lim {x[ se —z]} = lim cael =0 (e< 1). 
X—> + 00 x—> +00 


(6.473) 
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Fic. 13. The Fresnel integrals S(x) and C(x), x?=z, 


Some integrals are: 


ie Stax) dx = pS(an)+ OO (6.474) 
i " CGky de = pC (6.475) 
0 « /272 





2 
Bs 2/2 cos = sin 

|, [2-80 |sin 2px dx = - — (p > 0); 
) 





wt P 
(6.476) 
[-[2-@] sin 2px dx = — oa ae (p > 0) 
oL2 a P ° 
(6.477) 


The graphs of the Fresnel integrals are shown in Fig. 13. 
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5. Gamma and beta functions of Euler 


The so-called Euler B- and I’-functions are important non-elementary 
functions, They are defined by improper integrals dependent on a 
parameter; they have been carefully studied, and fairly detailed tables 
have been compiled for them. 

The fundamental properties of the functions are described below. 
All the parameters appearing in the formulae are real. The operations 
employed, of differentiation, integration, change of the order of 
integrations, summation, etc., are valid, inasmuch as the integrals 
are absolutely and uniformly convergent for the values of the 
parameters considered. 

1°. Definitions, functional equations and elementary properties 
of the I (gamma)-function of Euler, For « > 0, Euler’s gamma 
function is defined by the integral 


T@) = { * xa-le-# dx, (6.478) 

Change of the variables leads e the formulae: 
TOs i (ms re (6.479) 
T@) =| exe~e dx. (6.480) 


Integration by parts of 6.478) gives 
Ia) = («-)Te-}) (6.481) 

and in general, for integral n and a > 0, we have 
I(a) = (a—1)(«—2)...(a@—n4+1)F@—n+1). (6.482) 

On putting « = n (integer ) in (6.482), we get 
I) =(n—1)! (6.483) 
Continuation of the gamma function into the negative semi-axis 
is accomplished in accordance with the formula 

I(a) 


I@-D= eat (6.484) 


Tx) = Fer) (6.485) 
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first into the interval (—1, 0), then into (—2, —1), so that, for —~n< 
<x< —(n—1), 


- I(x +n) 
rT (x) = X(x¢1)...(@4+n—1” (6.486) 
whence, for 0< a <1, 
Pen) =(-1" G ie) (6.487) 


—a)\(2—-a)...(n—a)° 


The function J(x+1) is often denoted by the symbol J/(x). 
The gamma function is discontinuous for all integral negative 
values of the argument, since it follows from (6.485) that 
lim |xTW(x+)| = . (6.488) 


z—_—— nr 
x>on 


It follows from (6.478) that, at points where the gamma function 
is continuous, its derivatives may be evaluated from the formulae 


I'(a) = ie x*—le-* In x dx, 
a (6.489) 
LA&(a) = | x*~1e% (In x)Rdx. 


0 


REMARK. An equation of the form 
F(x, y(x), y' (x), tee y™(x)) =0 


where F is a polynomial in its arguments x, y(x), y’(x), ..., ¥(x), is 
called an algebraic differential equation of the nth order. A function 
y(x) is described as Aypertranscendental if it is not a solution of any 
algebraic differential equation with polynomial coefficients. The 
function I(x) is hypertranscendental. 

For instance, y(x) = sin x is a solution of the algebraic equation 
y'*+y? = 1, so that it is not a hypertrascendental function. 

An elementary asymptotic formula. It follows from the inequality 
with 0 < « < 1) 


n*D(n)— e~Mnttn-1 < T(a+n) = 


. { Pas | "<< ne-AD(n el) tenmntte-1—— (6.490) 
0 n 
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that 
; I(a+n) 7” 
au, ar a9 (6.491) 
The representation of the gamma function as a series is mentioned 
in Chapter III, § 3. sec. 16. 
Expressions for I(«) and I(x) as infinite products. If we use 
(6.491) and replace I(a+n) in accordance with (6.482), we arrive 
at the Euler—Gauss formula 


n! 


Me) = I" GerNerD ery? 6) 
or 
T(@) = lim nt — zm (6.493) 
mee TT @+) 
»=0 


We can obtain from these last formulae, on making use of the 
transformation 


the Weierstrass formula 


1 _ uy) = hte TI baa er 6.494 

Te? (x) =e efi ((1+2)e ) ( ) 

where C is the Euler—Mascheroni constant (6.56). 
The formula for the complement 

a 

sin 7a 


I@ri-a) = (6.495) 
follows from (6.493) and the formula 


sin 7% . = ot 





ea N—> co vel 
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In particular, it follows from (6.495) that 


1 
r(4) evar. (6.496) 


Since we have, from the formula for the complement, 


1 2 n—1\]? gna 
[ra)r(ayr--( n )| Shae 5° OH . n—-l ’ 
sin — sin —... sin % 
n n n 


(6.497) 








we obtain, in view of the relationship 
3 n 
sin — = 5nxr 
mrt n Qn-1 
the Euler product: 


n-1 


1 2 n-1 _ Qn 
r()r(2)..1(4)- 2. eo 


The multiplication formula 





= y eS ee 
I r(x +4) = (2x) 2k 2T(kx), x>0, k is an integer=1, 
v=0 (6.499) 


follows from (6.493). When k = 2, we get the (Legendre) doubling 
formula 


Tet (« +4) = Sm tt T'(2a). (6.500) 


The logarithm of the gamma function. On taking logarithms of (6.493) 
and passing to the integrals, we arrive at the integral form of the 
logarithm of the gamma function: 


= n n 
In al" («) = (i Pepin -zinty) = 





n=) 
oo 0 nx. o(n+a)x Nx p(n+1)x 

7 | (oS aoe as 
n=1}]_. x x 

_ fe 1-et*—a(1 —e) 

=) See 





In Ta) = . [Sst ~@-ne]€. (6.501) 
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Other integral forms are: 


ee -, d+)-"-01+9 
In F(a) =[/ [ «ne water |r ra a>0, (6.502) 


inne) = [| o Ag DF > 0. (6.503 
a= [ @-) |, a> 0. (6.503) 


Raabe’s formula. On taking logarithms of the Euler product 
(6.498), we get 


and if 


we have 
1 
| In I'(a) dx = In 2x. (6.504) 
0 


The Raabe integral is obtained by differentiation with respect 
to the parameter: 


Fm [ inTe+s) ax = a Qne—14in J/2n). (6.505) 
0 


Another expression for the Raabe integral is obtained by inte- 
gration of (6.501): 


0 dxT e & 1 
It follows from (6.501), (6.506) that 


In I(a)-—J au ae ef fe dx, (6.507) 


where 





1 1 1 1 
fo) = ees -5+7): 
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On introducing the Binet function 


oa) = | fxder de, (6.508) 


we get an asymptotic expression for the logarithm of the gamma- 
function: 


InI(@) = In va+(« -4) In «—a-+-a(«). (6.509) 


It also follows from (6.501) and (6.506) that 


J-nT (= +3) = | °  F(xer® dex, (6.510) 


where 


roy = (4-4). 


From this we obtain an asymptotic formula for r(#+3): 





In’ (« +5) =a(ne—1) +1n /21—,(<), (6.511) 
where 


Oe | ° F(xee® de. (6.512) 


The following relationship holds: 
O(a) = w(x) — (22); (6.513) 


it is obtained by taking logarithms of the doubling formula (6.500) 
and substituting for In I(x) and In I(2x) in accordance with (6.509) 


and forIn I («+3) in accordance with (6.511). 
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The following formulae are due to Schaar: 


2e%* dx 


0 n £0 
w(x) = Lae dx = ae 4 4 = 


1 at + x? 


al ea dx in(1—e*), (6.514) 
0 


1(-" ad Uy ieee 
o,(a) = =, sees In (-em)— 2 | aa (1 — e2#*) = 


1 fo adx 
=a/ or inl erm) (6.515) 


4 


The Stirling and Gauss asymptotic formulae. By using (6.179) and 
(6.508), we can obtain the Stirling series for the Binet function: 





_ B 1, B 1 
po ioe’ 34a 
Bon—2 1 
+ Opa Grad as gen-3 +R, (6.516) 
where 
R=46 Ban 1 es ee hie 
mt (2n—1)2n a2n-1 ? . 517) 
When 1 = 1 
0 
ale) = 052 = a, 


and Stirling’s formula follows from (6.509): 


in Te = in ViR+(«—4) na at, (6518) 


a oe 
D(a) = Jina te" ae (6.519) 


Stirling’s formula is again obtammed when « is equal to aninteger m: 


6 
Pen oer (2) em. (6.520) 
e 
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An asymptotic formula for @,(«) follows from (6.513) and (6.516): 
_ B 1\1. B 1\ 1 
a F( -z)etae(! -x)3+ 


B, 1\ 1 


In particular, 


1 
w(2) = 6 —* Tr r(! -3)e oe 0<6<1. (6.522) 


Gauss’s formula follows from (6.522): 


1 Cf] 
In r(« +4) =a(Inz—1)+ In Jin 57. (6.523) 


: . 1 4 ; 
When » is an integer and « = nts, a formula is obtained fora 


factorial that gives a better approximation than Stirling’s formula: 


1 ine 
n +z _ 8 
e 2an+12 , (6.524) 





| 


The power expansion of the logarithm of a aed function. It 
follows from (6.481) and (6.493) that 


log F(1+a)= 


_ (% d& I''(2) . afl 1 = 
o[z tl me), Cos ae) |# 


e€ 





Bot tat..., (6.525) 


where 
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The trigonometric expansion of the logarithm of the gamma 
Junction (Kummer’s series). If, when x€ (0, 1), 


InT(@) = 2+ ¥° (aq cos nna +b, sin 2nnx), (6.526) 
n=l 
where 
1 
= 2 In I’ (x) cos 2mmx dx (n= 0, 1, 2, ...), 
0 


(6.527) 
b, = 2 [In FG) sin mee ax (n = 1, 2, 3, ...), 
Q 
we have by the formula for the complement: 
InI(@)+iIn(l—e@) = apt y 2a,, Cos 2nna = 
n=) 
= In2n— Insinzx = In2x+ ¥ 58 er (6.528) 
n=l 


whence 


5% =In J2n, a, = > (n= 1, 2,...). (6.529) 


We have from (6.502) and (6.64): 


ae 
bn a Te ee x41) sin dex d= 
1 du du 
_— — e~anzu _e- 
== (re ees es as (ae a ikl 


cess UL e-antu) ww — 
i =i i (e~*—e uy Hu 7 — 1 C+in 2nn). (6.530) 
Further expansions of the logarithm of the gamma function are 


InT(i+e) = ———— — Ca -S —e «2+, (6.531) 


“ Qsinzx 2° 1l-a@ 


a3 ad 
+(1—C)2— (85-1) = (5-1) .--- (6532) 
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The logarithmic derivatives of the gamma function (the psi or 


digamma function). By definition, 
I'(@ 4d 





wa) = F2 = Fare; 
Wa) = Tete a SZ inT(a+0, 
so that 
Pa) = ya) +=. 


The function (a) satisfies the functional equations: 
l 
pl +%)— (a) = x 
ywa)—p(l—x) = —x tana, 


y(a)-—p(—«) = —2 tanna——. 


p(1+2)--yp(l-a) = — tana +. 


1 1 
y (s+ “)-» (3- 2) = wtan me. 
m-1 r 
yma) = m1) o(« +E)+ In m. 
rd m 
It follows from (6.492) that 


I’ () _ 1 = 
WT @. a | 


or, in View of the fact that 





we have 








= 1 1 
Ye) = ~c+ i mz)’ 





(6.533) 


(6.534) 
(6.535) 
(6.536) 


(6.537) 
(6.538) 


(6.539) 


(6.540) 


(6.541) 
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It follows from (6.541) that 


eo / ft 1 
ya) = ~c+ 5 ( | frat — { esa) = 
yr 0\Jo 0 
1-1 


Sioce f. 5 — at. (6.542) 
0 -—t 


On carrying out the change of variable 1+ y = 71, and taking 
account of (6.63), Cauchy’s formula is obtained: 


ya) = | : jer air |* a>0. (6.543) 
0 


Other integral forms are: 


co pt e~ta 
(2) = -¢+[ <a s dt,  a>0; (6.544) 
0 
hed ent enta 
ya) = ee dt, a > 0; (6.545) 
o 
t dt 
wo) = Ina«—-— -2[" rae Fayert— Ve (6.546) 


7 ae Oe ce 
y(a) = | (2 dt »>0; (6.547) 
0 


Int /-t 


y(a) = { “1a4+97-a4+0-94-6, a> 0. (6.548) 
0 


Some particular values of the gamma function and its derivatives 
are: 


T(1) = FQ) = 1; (6.549) 
I(0:5) = Jr; (6.550) 
I(-05) = -2/7; (6.551) 
ru +5) = ae (2n—1)!!; (6.552) 
1 2n 
r(z- n)= = (= IY De oe: (6.553) 


yl) = — C; (6.554) 
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»(z) = —C—21n2: 


—31n2; 
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(6.555) 


(6.556) 


(6.557) 


(6.558) 


(6.559) 


The-graphs of I(x), A(x), 1/I(x) and 1/17(x) are shown in Fig. 14 


and 15. 





Fic. 14. The gamma functions I(x) and I'(x+1) = A(x). 
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Fic. 15, The functions 1/I(x) and 1/J7(x). 


Properties uniquely defining the gamma function. A function F(x), 
continuous along with its derivative for x >0, is a gamma function 
I(x) if it satisfies any one of the groups of conditions enumerated 
below: 


I, (a) Ft) = xFO), 
(b) F(x)F (1—x) = 





sin 7x’ 
(c) F(x)F (= += i) ae 
Il. (a) F(x+1) = xF(X), 


(b) Foor (x+ 3)- V™_ FQx), 











2 Q2x-1 
(c) F(x) #0 for x>0. 


III. (a) F(1) = 1, 
(b) F(x+1) = xF(x), 
(c) F(x) is a logarithmically convex function for x >0 (see 
Chapter I, § 3, sec. 17). 


IV. (a) FU) = 1, 
(b) F(x+1) = xF(x), 
(c) (e/x)*F(x) is decreasing for x > 0 (or x > M). 
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2°. Definitions, functional equations and elementary properties of the 
B (beta)-function of Euler. Euler’s beta function is defined by the 
integral 


Ble, 6) = [ca-2r ie SOL. Pacer Es) 
0 


Integration by parts leads to the functional relationships 


B(% 8) = ASS Bi, B-1), B>1, (6561) 


B(«, B) = “oa B(a-1, f), «>1. (6.562) 


The B-function is symmetrical: 
Ba, 8) = B(B,). (6.563) 


The connection between the binomial coefficients and their general- 
ization. Since, when m and n are positive integers, 


(n—1)'(n—1)! 


B(m, 2) = oD (6.564) 
we have 
1 _ [mtn-l)\ | 
nB (m, n) =( m—1 ). ee 
1 _ {mtn-1 oe ) 
aE may = ( n—1 ); 
whence, when «>0, B>0, 
a+b—-1\ _ 1 
(321) - aren se 
a+B-1\ _ 1 
( B-1 )= Ben: ee 


An expression in terms of the gamma function. On replacing x in 
(6.560) by y/(1+y), we arrive at the formula 


eye -tdy 
B (a, B) = esas (6.568) 
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whence 
py. (7 L@ +B dy _ 
= ie e-*(1+y) xx +B-1 ya-1 dx dy = 
oJo 
a x e—=xP-1 dx i: e~U(xy)*-ld(xy), (6.569) 
0 0 
and finally, 
B(x, B) = 7 ey ; (6.570) 


Other integral forms are: 


/2 
B(z, B) = 2 sin2*—1lp cos??-1pdp; (6.571) 


0 


/2 
B(a, B) = 2 i sin cos*Ppdp, = a > -5. p> = (6.572) 
0 


f2a-1 
B (a, B) = if Gi coed t= 2 Cae Fern tH (6.573) 


a>0, B>0; 
1 te-1 4 ph +1 
B(«, 8) = | —— =; dt, «>0, B>O; (6.574) 
0 (+s) iP 
1 (1—1t)?-1 dt 
B(a,«) = roan Scala (6.575) 
a ae 


Representations as a series and infinite product: 


] oo 
Ba, B) = 5m, | (i Ae B > 0; (6.576) 
“Ke+B+h) 


B(a, 8) = aul GHEXEED: (6.577) 
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6. Bessel functions 


The Bessel functions of the first kind J,(x) are defined as the 
coefficients of the power expansion in the variable ¢ of the generating 


+) 
tJ”. 


Lane 2 eee 
ate Dee ae 


ei at 
function e 


2 2 (—1)exttepr-s 


= yD, 


a SA — a 
DL preg gta oe 658) 


yee 6.579 
AYR peemieaiay = eee) 


Jens) = (—1)°7,0). (6.580 


The Bessel functions of an imaginary argument J,(x) are defined 
from the relationship 


1 ex co 
en FMF FS TG; (6.581) 


Nez —oco 


EOYs 2. 2n+28(n +5)! 5!” 


xnt 2° 


(6.582) 


Ip(x) = i-* J, (ix), (6.583) 
Lin(*) = i7J_9(ix) = i"(—1)"J,(ix) = in "J, (ix) = Iy(x). (6.584) 


The trigonometric forms of the generating functions. It follows 
from (6.578) with ¢ = e’? that 


eixsin eg = J,(x)+ 2iJ,(x) sing + 
+ 2J,(x) cos 2¢ + 2iJ,(x) sin 29 +2J,(x) cos4p+..., (6.585) 


whence 


cos (x sin p) = Jolx) +2 ¥° Jog(x) cos 2kq, (6.586) 
kel 


sin (x sing) = 2 3° Jonys(x) sin (2k + Do, (6.587) 
k=0 
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and similarly, 


eineose = J,(x)+2 ° i*J,(x) cos sp, (6.588) 
sal 


cos (x cos ~) = Jo(x) +2 x (— 1)" Jo,(x) cos 2k, (6.589) 
1 


sin (x cos y) = 2 ¥ (—1)*Jonyi(x) cos(2k-+1)p. (6.590) 
k 


Bessel’s integral. On regarding (6.586), (6.587), (6.589), (6.590) as 
Fourier expansions, we get 


aJ,(x) for n= 2k, n=0, 
0 for n= 2k+1. 
0 for n=0, n, =2k, 
aJ,(x) for n= 2k+1. 


[; cos np cos (x sin y) dp = { (6.591) 


0 


(6.592) 


(4) 


{ sin ny sin (x sin 9) dp = | 

It follows from these formulae that 

J,(x) = ak cos (np — x sin p) dp (Bessel) (6.593) 
0 


where 7 is zero or a positive integer. 
Addition theorem. Since 


$(uto(iet-y) Putt) — 2 oft-t-1) 
=e e = 


> J(u +v)t™ = e? 


n= 


= > Jue FY J(yr, 
we have 
Jute) = Yo IWInal0, (6.594) 


or 


Jn(u+0) = > J.) Jna(0) + 


5 x (— 18 {Je(u)Jnae() +Jnze(u)Je(r)}. (6.595) 
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Similarly, 


In(u+0) = Yaa) = ¥ Ins) + 


+ y {I,(uIngs) + Ing a()1,(v)}. (6.596) 





Fic. 16. 


The addition theorem in Neumann’s form. It follows from Fig. 16 
that 


R= Jr? +0%—2ro cosy, 
Roos (p +x) = tcosa+ocos PB = rcosx+ocos(t—-p+2)= 


= rcosa+ocos(a—y), 
whence 


Tim In(ReimPein® = YM n(r)eim® Y (— it (ohelvell* = 
= Lire FY (-DNOM-Me, (6.597) 
and 
TRE =F (-MVOIne™, (6.598) 
Jn(R) cos np = Ae 1)'J(0\Jn_(r) cos ly, —(6.599) 


J,(R) sin np = Y (—1)'#J,(0)Jn_i() sin Ip. (6.600) 
U 
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When n = 0, 
JAR) = Jo(R)Jo(0)A(r) cos lp (6.601) 


When r = 0, R= 20 sin5-y =z sin 6, 


J,(z sin 6) = a(S )+25 » A(F ) eos 216. (6.602) 
Bessel’s differential equation, which is satisfied by the Bessel 


functions J,,(x), is 


wt 
de 


Correspondingly, the J,(x) satisfy the equation 


oY xB +(02—m)y = 0. (6.603) 


dty 


Ze OF xB cty n)y = 0. (6.604) 


Recurrence relations are: 


Ina) = = In) — Jn); (6.605) 
Ina) = = In(3) + Jn); (6.606) 
Tae) = ates Ines) (6.607) 
Inga) + Ina) = 2 In(); (6.608) 


d 
Fy rn) = x Tis NJn) = —X7~™JInay. (6.609) 


ro 
The Bessel functions of the first kind J,(x), m not an integer, 


—1) x \n+28 
J,(x) = y Tern Tessy (F ) (6.610) 


satisfy the differential equation (6.603). 
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A second linearly independent solution of this equation is provided 
by the function J_,(x) (# not an integer), so that the general solution 
has the form 


y= Cy (x) + Con); 


where C, and Cy, are arbitrary constants, The recurrence formulae 
(6.605)—(6.609) also hold for J,(x), where n is not an integer. 
Bessel functions of the first kind J (x), where 7 is an integer, 


at? 


are expressible in terms of elementary functions; in particular, 
L (si 4 
x\2 = =I} x \3s 
o- Omaha 
2 “resnr(z+s+1) 


x\t {2s x28 2x sin x 2s 
=(2)z [4 of i a, NS EE ee CP See tes 
(3) eo! Gail = x me 


(6.611) 


2 
y_ 1 (x) = |= cos Xs (6.612) 


Expressions for J, (x), n any integer, can be obtained by successive 
n+> 
2 
applications of the recurrence formulae. . 
Bessel functions of the second kind Y,(x) (Weber functions) are 
expressible in terms of Bessel functions of the first kind with the aid 
of the equations: 


Y,(x) = lim Se) 008 AFA) for n an integer (6.613) 
von i! 


_ Jn(x) cos nt — J_ p(x) : 

Y,(x) = aes 5 aan for n not an integer. (6.614) 

Like J,(x), the function Y,(x) satisfies the differential equation 

(6.603), the general solution of which has the form, when z is an inte- 
ger, y = C,J,(x) + GY, (2). 
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The Macdonald function is usually taken as the second solution of 
equation (6.604): 


1 TnlX)— Il) 


3 SaGer for n not an integer. (6.615) 


- K(x) = 


The recurrence formulae are: 


Far) = = Yate) - Ya@): (6.616) 

Yna1@) = = Yn(2)-+ Ya); (6.617) 

Ya) = 5 [¥na1(8)— Faun Qh (6.618) 

Ynaa + Yaa) = 2 YQ); (6.619) 

In@)— hae = —2 0); (6.620) 
2n 

Kn+1(x) — Kn-a(x) = ere n(X)- (6.621) 


Relationships between Bessel functions of the first and second 
kinds are: 


ID¥ni- Yon) = 3 (6.622) 


Iy2)Knaa@) + Kuna) = (6.623) 


Representations as Series are: 


AP DPE LP 
J,(x) = 1-(5) +o (3) -an(3) Piview $ (6.624) 


7 
y+ ates (6.625) 





¥,(x) = (c+m 2) 10(2)- => aaa (z)" Des 5 (6.626) 
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2 x 2 
¥,(x) = 3 (¢+3) 12) - 2 - 
1 
% ni 


oo (- 1y" x \2nt1 n 1 1 ; 
2, al @+iy! (3) (2 Jatm) en 
2 4 6 
I(x) = 14 z)* an(3) +an(z) oer (6.628) 
5 q 
I(x) = zta(z) tals) +aa(z) pees (6.629) 
= 1 (x\™ al. 
K,(x) = -(C+m 7) 60+ 5 cax(Z) AE (6.630) 
K(x) (c+m 5) Ia)+4 - 


20 1 x \2n+1 (ntl J 1 
ps nl (n+1)! (=) (Sem) ee 


where C is Euler’s constant (see § 1, sec. 1, 3°). 
Asymptotic formulae (for large values of x) are: 


Jo(x) © iz Ee sin (=+3 =) 4.0468 cos (« +4)]; (6.632) 
2 ; Ed wv 

Jy(x) » “it sin ea cos S y) ; (6.633) 
2 


1% 
WX Rie Oe 
2 1 

Y,(x) = i= f — P,(x) cos (= “) +Q,(x) sin ’ -3)] 3 (6.635) 


where 
EP Ra 
2!(8x)? “4! (8x)4 ore 
1 12,3%,52 
QM) = —Tet BIG 
12.3.5 12.32.52.7.9 
2! (8x)? 4! (8x)4 ae: 


1.3. 12.32.5.7 
2) = 3x7 ea 


P(x) = 1 


Pye) = 14 
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e 1212.32 42,3282 
Ix) yy — — + YH ites 
22x 8x 2!(8x)? — 31(8x)? 
2 2 32 
10) x (1-13. 235. _ R57), 
2x. 8x 21(8x)® 31 (8x) 
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Fic. 18. Bessel functions of the first kind J,(x), J3(x), Jg(x), Jyq(x). 


(6.636) 


(6.637) 
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y= %x) 





2x 


Fic. 20. Bessel functions of the Fic. 21. Bessel functions of the 
first kind J,(x) and 2,(x). second kind K,(x) and K,(x). 


nee gt, ee aS : 
KRONe | z(1 tae ee tej} 6.638) 
oe PEC, 13 13S, RST 
Bie) e* fE( Bx Difax! Senet) 
(6.639) 


Graphs of Bessel functions are shown in Fig. 17, 18, 19, 20 and 21. 


NOMENCLATURE 


(a b) — The interval a<x<b 

[- =, a) — The infinite interval x<a 

[b, + -) — The infinite interval x>b 

[a, b] — The segment ae x=b 

(a, b} — The semi-interval a<xab 

[@2, b) — The semi-interval asx<b 

(— ~,a] — Theinfinite semi-interval xsa 

{b, + ©) — The infinite semi-interval x =6 

{x,} — The set of elements x, 

x€X— The element x belongs to the set X¥ 

xe€X or x ¢ X — The element x does not belong to the set Y 

XcY — The set YX is a subset of the set Y 

XcYorXe Y — Theset X is not a subset of the set Y 

AUB or A+B — The union (sum) of sets A and B 

AB, or AXB, or A-B or AB— The intersection (product) of sets A and B 
B\A or B—A — The complement of the set 4 with respect to the set B 


x — Thestrict upper bound of the set _Y 

cn f(x) — The strict upper bound of the function f on the set X 
ne — The strict lower bound of the set _X 
“ints (x) — The strict lower bound of the function f on the set Y 
ae {@, az, ..., @,} — The greatest of the numbers a,, a,,..-, a, 


min {@,, @,, ..., @,} — The least of the numbers a, a, ..., a, 


n 
ee = {a,, a, ..., dq, ...} — The sequence with the general term a, 
Q,_} — A double sequence 
o(2,) — a, is an infinitesimal of lower order with respect to 8, if B,~O(a, ) 
O(@,) — a, has a rate of decrease not faster than £, 
o{x), O(x) -— Orders of the function x 
lim JS(x) — The limit of the function f(x) as x ~ x9, x¢ X 
x—> x, LEX 
E, — One-dimensional coordinate space (numerical axis) 
E,, — n-dimensional coordinate space 
E,+£,_, — The direct sum of manifolds 
o(X, Y) — A distance 
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6(0, 0, ..., 0) — The origin of coordinates 
S(O) =f(%,, Xe, -.-5 X,) — A linear function, or a function of a vector (point) 
\| Xl] — The norm of the vector X 
Pz,x,... x, — Gram’s determinant for vectors 
L, — n-dimensional linear system 
X | E, — The vector X of E, is orthogonal to E, 
prz,X — The projection of the vector X on to E, 
Prz,X — The projection of the vector X on to the vector Uy 
lim S(X) — The limit of the function f(X), when X€M tends to A 
X— A(X € M) 
Q, — The exterior domain 
Q,— The interior domain 
F = (fi, fo «++» Sf) —An operator 
Y= F(X) — The vector form of writing an operator 
Ye = SEX) = fi%y, Xe, ..~3 X) — The coordinate form of writing an operator 
Ve = AX + AygXo+ ... +44,X%, (i = 1, 2, ..., 2) — The coordinat> form of 
writing a linear operator 
Eng — The space with norm 9(X) 
Eng = Exe — The space E,y is conjugate to the space E,, 
Pa = PiPe- ++ Pm — The mth partial product 
{P,.} - The sequence of partial products 


Tm = PmsiPmee s+ = I] P, — The remainder product 


: n=m+1 
eo 
Yay — A double series 
k,l a0 


R — The radius of convergence of a power series 
r,(x) — The remainder term of the Taylor series 


F(x) ~ y A,/2* — The asymptotic expansion of the function F(x) 
k=0 


b 
(fg) -| S(x)g(x) do(x) — The scalar (inner) product of the functions f(x) 
and 0 


\|f|| ~The norm of a function 
b me 

lf-gii = | (f-—g)? do(x) — The root square deviation of functions f and g 
a 


r, f(x) — The nth-order inverse derivative of {(x) 
a, a a, 
Oe bs A GS toe: 
P,/Q, — The mth convergent of the fraction 
K, K — The ordinary and singular values of the same continued fraction 
C — The Euler—Mascheroni constant 
G -— Catalan’s constant 


—A non-terminating continued fraction 
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n'! — Factorial n 

n'! — Double factorial n 

Onm OF On Kronecker delta. 

G.) or Cy — The binomial coefficients 

P,(x), P,(x), P,(x) — Arbitrary orthogonal polynomials 

B,, — Bernoulli numbers 

B,(x) — Bernoulli polynomials 

Pal) mH B,(x)—B, 

B,(f) — Bernshtein polynomials 

L°(x), L(x). L°(x) — Laguerre polynomials 

L,(2), L,(x), L(x), |, — Legendre polynomials 

T,(x), T,(x), T(x) — Chebyshev polynomials of the first kind 
U, (2), U,@2), U,(x) — Chebyshev polynomials of the second kind 
P,, w(x) — Chebyshev polynomials with respect to a system of points 
£, — Euler numbers 

E,(x) ~ Euler polynomials 

H,(x), H,(x), H,(x) — Hermite polynomials 

Tis W(x), TO W(x), J W(x), {9 M(x) — Jacobi polynomials 
|x| — The absolute value of x 

sign x — The sign of x 

[x] or E(x) — The integral part of x 

{x} — The fractional part of x 

(x) — The distance to the nearest integer 

1(x) — Heaviside’s unit function 

d(x) —The delta function 

B(a, £) — Euler’s beta function 

I(«) — Euler’s gamma function 

Ei(x) — The integral exponential function 

Ei(x) — The real part of Ei(x) 

lix — The integral logarithm 

si (x) or Six — The integral sine 

cix or Cix —The integra] cosine 

erf x, p(x), p,(x), erfc x, L(x) — The error function. 

F(k, g) — The elliptic integral of the first kind 

E(k, ~) — The elliptic integral of the second kind 

IT (k, 4, y) — The elliptic integral of the third kind 

Dk, p) — [F(k, p) — E(k, p)I/k* 

K — The complete elliptic integral of the first kind 

E — The complete elliptic integral of the second kind 

D = (K-E)/k? 

y(a), Ya) — The logarithmic derivative of the gamma function (the psi functions) 
S(x), S*(x) — The Fresnel sine integral 

C(x), C*(x) — The Fresnel cosine integral 


NOMENCLATURE 


J,(x) — Bessel function of the first kind 

Y,(x) — Bessel function of the second kind 

I(x) — Bessel function of an imaginary argument 
K,(x) ~ Macdonald function 
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concave 36 
continuous 29, 58 


INDEX 399 


convex 35, 73-6 


delta 343 e 
discontinuous 29 
error 357-9 


approximate expansion as 281 
exponential, integral 277, 351, 352, 
354, 355, 356 
expansion as continued fraction 
273 
gamma 362-74 
continued fraction approximation 
for 282 
incomplete 278 
generating 151 
for Bernoulli polynomials 327 
for Chebyshev polynomials 225 
for Euler polynomials 334 
for Jacobi polynomials 221 
for Laguerre polynomials 235 
for Legendre polynomials 216 
Haar 181 
Heaviside 341 
hypertranscendental 363 
integral 351-6 
inverse 13 
jump 60 
Laplace 185 
left continuous 29 
logarithmically convex 36 
linear 45 
Macdonald 382 
monotonic 34 
odd 13 
of complex variable 130 
of several variables 57 
orthogonal 177, 184 
Pearson 210 
periodic 14, 62-4 


piecewise 
linear 337-45 
smooth 133 


polygonal 338 

Rademacher 340 

right continuous 29 
smooth 133 

square integrable 177 
uniformly continuous 30, 59 
vector 57, 67 

Weber 381 


weight 178 
Functional 31 


Gamma function 362-74 
continued fraction approximation 
282 
incomplete 278 
Gauss 
convergence test 99 
formula 316, 369 


‘Gram determinant 46, 186 


Haar function 181 
Hahn-Banach theorem 79 
Half-space 72 
Heaviside function 341 
Hermite polynomials 236-7 
Hyperplane 48 

of support 76, 79 


Image 14 
Independence, linear 43, 187 
Inequality 

Bessel’s 173, 189 
Brunno-Minkovskii’s 83 
Cauchy’s 41 
Cauchy-Bunyakovskii’s 177 
for e 309 

for z 307 

triangle 40, 76 
Infinitesimal 33 
Integral 

Bessel 378 

elliptic 346-51 

of first kind 346 

of second kind 346 

of third kind 346 
Fresnel 

cosine 359 

sine 359 

Raabe 366 
Intersection of sets 5 
Interval 4 

closed 5 

infinite 5 

semi-closed 5 
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Jacobi irrational 1 
polynomials 219-23 natural 4, 
weight 210 transcendental 1 
Numerator, partial 241 
Laguerre polynomials 233-5 
Laplace Operator 65 
formula 323 continuous 66 
function 185 linear 67 
transform 150 Order 
Lebesgue of Fourier coefficients 136 
function of orthonormal system of an infinitesimal 33 
209 Origin 2 
integral 171 
Legendre 
polynomials 151, 214-9 Parseval’s equation 173, 190 
weight 211 Pearson 
Limit equation 210 
lower 24 function 210 


of a convex body 73 
of a function 28 
point 19, 55 

upper 24 


Macdonald function 382 
Machin’s formula 305 
Majorant of a series 89, 90, 118 
Manifold 

linear 47 

of constancy 62-4 
Mapping 13, 66 
contraction 70 
symmetric 83 

Metric 39 

Euclidean 39 
Metrization 54 
Modulus 2 
complementary 346 


Norm 33 

of a function 179 
of a vector 41, 172 
Number(s) 

algebraic 1 
Bernoulli 322-32 
Euler 332-6 
Fibonacci 321 


weight 213 
Period 
of a function 15 
fundamental 63 
Point 
boundary 55, 72 
of condensation 54 
fixed 69 
interior 72 
limit 19, 55 
of sharpening 82 
singular 131 
Poisson summation 143 
Polyhedron 
convex 73 
reciprocal 81 
Polynomials 
Bernoulli 153, 327-32 
Bernshtein 320 
Chebyshev 151, 237-40 
of first kind 223-30 
of second kind 230-3 
Hermite 236-7 
Jacobi 219-23 
ultraspherical 220 
Laguerre 233-5 
Legendre 151, 214-9 
of second kind 202 
orthogonal systems of 197-240 
convergence of Fourier series in 
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207-10, 218, 228, 232 
recurrence relations for 199, 
221, 224, 231, 234, 236 
Power moments 200-1 
Power series 120-9 
differentiation of 123 
integration of 123 
Pre-image 150 
Process 
iterative 69 
Schmidt orthogonalization 188 
Product 
Euler 365 
infinite 105 
convergence of 105-9 
inner 41, 176-9 
of sets 5 
scalar 41, 176-9 


Quotient, partial 241 


Raabe 

formula 366 

integral 366 
Rademacher function 340 
Radius of convergence 121 
Range of a function 10 
Relation, recurrence 

for Bernoulli numbers 322 

for Bernoulli polynomials 328 

for Chebyshev polynomials 224 

231 

for continued fractions 243 

for Euler numbers 332 

for Euler polynomials 335 

for Fourier series 199-200, 221, 

224, 231, 234, 236 

for Hermite polynomials 236 

for Jacobi polynomials 221 

for Laguerre polynomials 234 

for Legendre polynomials 215 
Remainder term 

of a double series 114 

estimates of 93-4 

of aseries 92 

of Taylor series 123-6 
Rodrigue’s formula 213, 220 
Root square deviation 179 


Schaar’s formula 368. 
Schauder’s basis 339 
Schmidt orthogonalization process 
188 

Section 

Dedekind 7 

golden 321 
Segment 5 
Sequence 

confinal 8 

convergent 20 
delta-shaped 34¢ 
divergent 21 

double 11 

equivalent 7 

functional 30 
fundamental 7, 21, 54 
iterative 26, 67 
monotonic 18 
numerical 16 

recurrent 26 

uniformly distributed 25 
Series 86-169 

absolutely convergent 90 
alternating 90, 103 
asymptotic 140-2 
conditionally convergent 90 
convergent 87, 99 
divergent 87 

double 109-117 
Fourier 132-9, 191-4 
of functions 117-46 
Harmonic 89 
Kummer’s 370 
Leibniz’s 305 

negative 90 

orthogonal 170-240 
positive 90 

recurrent 298 

use in solution of equations 

298-300 

semi-normal 203 
Stirling’s 282, 316 
trigonometric 132-40, 161-9 
vector 56 
Set 4 

bounded 6 

closed 55 

complete 8, 9 

convex 72 
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Lebesgue 12 
open 55 
Space 
conjugate 78 
Euclidean 39 
Hilbert 170° 
n-dimensional 39 
linear 54 
vector 40 
Stirling’s formula 316, 368 
Stoltz’s theorem 247 
Subset 5 
Sum 
generalized 142-6 
of series 86 
of sets 5 
partial 56, 86 
Summation of series 
Cesaro 143 
generalized 142-6 
numerical 146-69 
Poisson 143 
Support 
function 77 
hyperplane 76, 79 
System 
binary 3 
biorthogonal system of functions 
51, 194-7 
closed 190 
decimal 2 
linear 42 
orthogonal systems 
of function 172-240 
of polynomials 197-240 
of trigonometric functions 174 


p-adic 2 


Transformation 70 

Abel’s 161-2 

Kummer’s 156-7 

of continual fractions 244 
orthogonal 50 

Similitude 83 


Uniform convergence 51 
test for 32 
Union of sets 5 


Value 

ordinary 246 
Singular 246 
Vector space 40 


Wallis’s formula 305 
Weber function 381 
Weierstrass’s formula 364 
Weight 176 

Chebyshev’s 210 
Chebyshev—Hermite’s 211 
Chebyshev-Laguerre’s 211 
function 176 

integra] 178 

Jacobi’s 210 

Legendre’s 210 
Pearson’s 213 


Zero, asymptotic 142 
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